-- Logs begin at Fri 2022-01-28 01:22:09 UTC, end at Fri 2022-01-28 02:19:48 UTC. -- Jan 28 01:52:47.455437 dv-cinder-824979-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 01:52:47.464697 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 01:52:47.466998 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 01:52:47 2022] *** Jan 28 01:52:47.466998 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 01:52:47.466998 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 01:52:47.466998 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: nodename: dv-cinder-824979-1-iscsi Jan 28 01:52:47.466998 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: machine: x86_64 Jan 28 01:52:47.466998 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: clock source: unix Jan 28 01:52:47.466998 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: pcre jit disabled Jan 28 01:52:47.466998 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: detected number of CPU cores: 4 Jan 28 01:52:47.466998 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: current working directory: / Jan 28 01:52:47.466998 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: detected binary path: /usr/bin/uwsgi-core Jan 28 01:52:47.466998 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: your processes number limit is 47680 Jan 28 01:52:47.467761 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: your memory page size is 4096 bytes Jan 28 01:52:47.467761 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: detected max file descriptor number: 2048 Jan 28 01:52:47.467761 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: lock engine: pthread robust mutexes Jan 28 01:52:47.467761 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: thunder lock: enabled Jan 28 01:52:47.467761 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 01:52:47.467761 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 01:52:47.511331 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: Python main interpreter initialized at 0x5590ec78e9c0 Jan 28 01:52:47.511331 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: python threads support enabled Jan 28 01:52:47.511331 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: your server socket listen backlog is limited to 100 connections Jan 28 01:52:47.511331 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: your mercy for graceful operations on workers is 90 seconds Jan 28 01:52:47.511627 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 01:52:47.511727 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: *** Operational MODE: preforking *** Jan 28 01:52:47.511989 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: *** uWSGI is running in multiple interpreter mode *** Jan 28 01:52:47.511989 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: spawned uWSGI master process (pid: 100628) Jan 28 01:52:47.512158 dv-cinder-824979-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 01:52:47.513500 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: spawned uWSGI worker 1 (pid: 100629, cores: 1) Jan 28 01:52:47.513500 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: spawned uWSGI worker 2 (pid: 100630, cores: 1) Jan 28 01:52:47.513500 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 01:52:49.158109 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:52:49.158109 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: from cryptography.utils import int_from_bytes Jan 28 01:52:49.158765 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:52:49.158765 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: from cryptography.utils import int_from_bytes Jan 28 01:52:49.162375 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:52:49.162375 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: from cryptography.utils import int_from_bytes Jan 28 01:52:49.162847 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:52:49.162847 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: from cryptography.utils import int_from_bytes Jan 28 01:52:51.864108 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:52:51.864638 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:52:51.864805 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:52:51.865162 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:52:51.865413 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:52:51.865819 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.865909 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:52:51.866257 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.866345 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:52:51.866443 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.866615 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:52:51.866747 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.866974 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:52:51.867080 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.867229 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:52:51.867361 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.867678 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.867762 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.868008 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.868097 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.868329 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.868413 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.868584 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.868670 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.868900 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.869001 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.869210 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824979-1-iscsi {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.869337 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.869527 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.869661 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.869856 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.869993 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.870165 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.870288 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.870459 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.870589 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.870765 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.870896 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.871081 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.871204 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824979-1-iscsi {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.871382 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.871515 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.871691 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.871873 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.872022 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.872313 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.872436 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.872614 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.872724 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.872923 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.873024 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.873245 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.873343 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.873553 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.873725 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.873899 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.874105 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.874330 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.874541 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.874770 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.874970 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.875177 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.875385 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.875556 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.875790 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.876000 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824979-1-iscsi {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.876206 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.876403 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.876617 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.876824 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.876994 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.877192 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.877399 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.877631 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.877861 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.878061 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.878268 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824979-1-iscsi {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.878443 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.878652 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.878791 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.878982 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.879138 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.879324 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.879481 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.879616 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.879760 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.879891 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.880063 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.880210 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.880343 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.880476 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.880615 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.880764 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.880902 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.881044 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.881178 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.881316 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.881499 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.881632 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.881794 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.881943 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.882078 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.882078 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.882337 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.882476 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.882690 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.882831 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.882971 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.883103 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.883730 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.883912 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.884128 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.884270 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.884408 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.884547 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.884681 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.884826 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.884970 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.885103 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.885236 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.885378 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.885521 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.885671 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.885850 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.885989 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.886122 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.886257 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.886402 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.886543 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.886683 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.886817 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.886950 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.887090 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.887248 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.887389 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.887523 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.887684 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.887822 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.887967 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.888101 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.888240 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.888374 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.888507 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.888638 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.888778 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.888917 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.889060 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.889193 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.889193 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.889536 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.889536 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.889829 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.889970 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.890102 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.890102 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.890358 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.890572 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.890716 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.890860 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.890992 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.891131 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.891270 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.891412 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.891546 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.891679 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.891679 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.891679 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.892061 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.892195 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.892331 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.892463 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.892606 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.892739 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.892879 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.893012 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.893012 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.893262 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.893393 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.893525 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.893669 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.893820 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.893968 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.894102 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.894233 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.894378 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.894518 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.894658 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.894799 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.894931 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.895063 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.895203 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.895343 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.895475 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.895607 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.895738 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.895914 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.896064 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.896208 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.896341 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.896511 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.896660 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.896817 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.896976 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.897116 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.897247 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.897410 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.897557 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.897697 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.897908 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.898063 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.898196 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.898328 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.898466 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.898606 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.898751 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.898945 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.899091 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.899255 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.899922 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.900068 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.900202 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.900400 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.900554 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.900711 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.900852 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.901020 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.901176 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.901310 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.901447 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.901613 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.901779 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.901955 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.902109 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.902244 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.902375 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.902545 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.902687 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.902863 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.903011 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.903168 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.903308 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.903471 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.903610 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.903785 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.903926 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.904085 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.904233 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.904389 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.904540 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.904685 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.904818 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.904993 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.905136 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.905297 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.905443 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.905585 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.905717 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.905912 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.906048 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.906187 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.906321 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.906527 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.906668 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.906834 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.906986 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.907140 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.907291 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.907432 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.907572 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.907736 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.907884 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.908040 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.908194 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.908337 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.908477 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.908643 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.908783 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.908951 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.909174 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.909316 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.909449 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.909591 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.909724 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.909891 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.910037 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.910178 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:52:51.910326 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.910500 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.910643 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.910831 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.910980 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.911175 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.911323 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.911488 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.911629 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.911800 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.911942 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.912113 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.912264 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.912436 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.912578 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.912744 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.912892 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.913051 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.913191 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.913357 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.913508 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.913672 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.913864 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.914001 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.914133 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.914307 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.914460 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.914655 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.914804 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.914958 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.915104 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.915279 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.915435 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.915577 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.915712 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.915889 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.916032 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.916203 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.916361 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.916505 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.916640 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.916812 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.916960 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.917137 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.917285 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.917458 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.917607 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.917773 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.917916 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.918101 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.918261 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.918396 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.918541 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.918716 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.918866 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.919009 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.919152 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.919320 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.919462 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.919628 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.919777 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.919942 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.920084 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.920250 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.920392 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.920558 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.920706 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.920876 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.921018 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.921189 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.921330 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.921500 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.921648 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.921825 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.921966 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.922121 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.922280 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.922414 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.922560 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.922722 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.922864 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.923022 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.923172 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.923338 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.923509 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.923650 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.923783 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.923940 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.924082 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.924259 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.924410 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.924545 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.924676 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.924855 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.924996 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.925167 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.925323 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.925464 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.925597 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.925800 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.925948 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.926108 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.926244 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.926376 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.926508 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.926687 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.926829 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.926993 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.927134 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.927300 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.927441 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.927616 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.927768 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.927911 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.928055 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.928208 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.928351 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.928521 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.928663 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.928827 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.928967 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.929132 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.929283 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.929425 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.929567 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.929757 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.929904 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.930060 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.930207 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.930392 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.930550 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.930963 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.931111 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.931278 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.931421 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.931564 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.931771 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.931907 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.932041 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.932184 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.932317 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.932497 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.932648 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.932784 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.932917 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.933093 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.933236 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.933400 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.933551 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.933694 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.933895 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.934031 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.934174 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.934318 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.934453 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.934587 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.934719 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.934881 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.935024 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.935188 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.935338 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.935485 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.935620 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.935778 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.935920 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.936096 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.936237 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.936398 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.936546 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.936681 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.936821 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.936986 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.937126 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.937286 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.937435 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.937570 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.937710 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.937880 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.938025 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.938191 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.938334 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.938534 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.938685 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.938843 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.938985 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.939184 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.939333 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.939491 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.939640 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.939806 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.939955 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.940106 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.940247 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.940411 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.940562 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.940720 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.940862 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.941028 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.941170 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.941337 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.941484 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.941643 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.941849 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.942002 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.942135 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.942275 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.942417 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.942580 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.942722 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.942888 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.943030 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.943199 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.943340 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.943498 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.943639 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.943813 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.943968 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.944133 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.944281 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.944421 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.944555 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.944743 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.944893 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.945075 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.945215 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.945390 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.945531 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.946221 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.946392 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.946552 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.946693 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.946839 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.946979 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.947140 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.947301 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.947443 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.947582 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.947752 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.947901 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.948063 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.948223 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.948372 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.948522 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.948662 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.948799 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.948974 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.949130 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.949273 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.949411 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.949581 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.949730 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.951635 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.951798 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.951949 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.952090 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.952249 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.952390 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.952390 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.952390 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.952390 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.952926 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.953074 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.953214 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.953361 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.953510 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.953655 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.953845 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.954004 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.954152 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.954302 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.954450 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.954593 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.954732 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.954871 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.955019 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.955160 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.955299 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.955438 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.955578 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.955717 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.955875 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.956023 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.956164 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.956303 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.956449 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.956596 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.956746 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.956894 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.957043 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.957190 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.957331 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.957469 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.957617 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.957792 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.957941 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.958081 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.958221 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.958375 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.958516 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.958655 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.958795 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.958933 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.959072 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.959223 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.959364 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.959509 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.959663 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.959809 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.959949 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.960101 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.960248 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.960394 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.960535 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.960673 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.960813 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.960960 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.961100 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.961239 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.961459 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.961619 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.961889 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.962042 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.962183 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.962323 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.962462 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.962601 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.962749 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.962890 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.963039 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.963180 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.963319 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.963468 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.963628 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.963770 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.963909 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.964049 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.964196 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.964337 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.964484 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.964632 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.964772 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.964942 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.965104 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.965259 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.965411 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.965550 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.965688 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.965858 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.965999 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.966155 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.966297 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.966444 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.966585 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.966724 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.966863 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.967010 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.967152 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.967300 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.967439 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.967585 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.967726 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.967873 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.968014 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.968161 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.968301 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.968440 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.968587 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.968728 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.968874 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.969015 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.969163 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.969303 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.969450 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.969591 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.969737 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.969953 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.970096 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.970249 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.970398 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.970539 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.970684 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.970825 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.970977 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.971116 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.971263 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.971404 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.971543 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.971681 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.971820 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.971967 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.972107 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.972245 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.972385 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.972523 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.972662 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.972822 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.972970 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.973117 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.973257 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.973397 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.973542 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.973696 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.973867 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.974009 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.974196 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.974345 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.974485 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.974633 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.974791 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.974940 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.975094 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.975243 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.975384 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.975524 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.975663 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.975816 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.975957 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.976096 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.976235 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.976374 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.976513 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.976671 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.976811 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.976972 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.977128 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.977275 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.977422 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.977571 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.977712 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.977892 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.978043 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.978190 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.978338 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.978495 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.978645 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.978792 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.978932 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.978932 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.979208 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.979349 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.979488 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.979626 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.979766 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.979904 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.980050 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.980190 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.980339 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.980478 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.980616 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.980755 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.980903 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.981042 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.981181 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.981320 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.981465 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.981613 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.981777 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.981925 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.982066 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.982215 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.982354 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.982504 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.982646 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.982785 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.982925 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.983063 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.983208 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.983356 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.983497 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.983646 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.983787 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.983936 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.984076 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.984290 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.984433 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.984572 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.984711 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.984859 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.985012 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.985152 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.985298 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.985438 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.985578 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.985716 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.985922 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.986067 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.986207 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.986346 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.986485 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.986631 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.986784 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.986924 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.987065 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.987204 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.987343 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.987490 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.987639 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.987788 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.987928 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.988068 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.988207 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.988354 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.988495 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.988634 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.988780 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.988920 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.989059 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.989207 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.989354 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.989494 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.989642 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.989803 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.989951 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.990102 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.990243 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.990382 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.990521 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.990667 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.990807 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.990958 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.991099 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.991239 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.991379 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.991527 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.991676 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.991816 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.991955 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.992094 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.992234 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.992373 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.992521 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.993172 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.993322 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.993470 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.993618 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.993798 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.993965 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.994108 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.994248 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.994389 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.994528 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.994667 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.994815 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.994956 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.995095 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.995234 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.995373 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.995522 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.995676 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.995823 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.995963 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.996110 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.996251 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.996398 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.996539 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.996679 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.996818 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.996964 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.997104 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.997251 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.997391 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.997540 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.997680 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.997857 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.998006 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.998163 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.998305 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.998455 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.998603 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.998744 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.998891 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.999038 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.999179 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.999318 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.999475 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.999617 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.999764 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:51.999905 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.000051 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.000197 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.000343 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.000483 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.000635 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.000776 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.000916 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.001055 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.001194 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.001344 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.001492 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.001633 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.001842 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.002002 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.002143 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.002282 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.002430 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.002580 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.002720 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.002860 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.002998 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.003159 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.003301 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.003439 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.003578 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.003722 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.003722 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.004011 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.004151 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.004292 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.004439 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.004579 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.004726 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.004875 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.005025 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.005165 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.005304 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.005442 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.005588 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.005736 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.005908 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.006048 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.006187 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.006342 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.006492 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.006632 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.006772 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.006921 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.007061 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.007200 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.007347 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.007487 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.007626 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.007764 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.007910 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.008057 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.008234 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.008429 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.008577 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.008718 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.008868 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.009007 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.009156 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.009297 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.009436 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.009575 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.009767 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.009932 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.010074 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.010224 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.010365 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.010504 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.010676 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.010833 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.010974 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.011111 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.011304 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.011458 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.011599 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.011810 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.011958 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.012096 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.012247 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.012388 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.012553 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.012721 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.012862 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.013001 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.013139 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.013279 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.013456 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.013605 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.013818 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.013968 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.014109 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.014294 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.014446 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.014588 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.014738 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.014877 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.015015 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.015154 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.015301 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.015441 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.015580 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.015717 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.015906 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.016056 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.016240 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.016389 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.016621 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.016768 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.016931 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.017088 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.017230 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.017376 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.017543 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.017693 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.017912 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.018072 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.018238 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.018387 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.018527 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.018684 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.018824 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.018971 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.019119 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.019259 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.019488 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.019635 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.019801 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.019962 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.020126 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.020275 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.020451 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.020607 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.020770 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.020910 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.021049 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.021194 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.021343 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.021483 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.021667 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.021867 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.022015 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.022126 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.022332 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.022469 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.022658 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.022792 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.023074 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.023164 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.023400 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.023512 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.023714 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.024305 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.024538 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.024634 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.024842 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.024929 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.025150 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.025261 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.025454 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.025559 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.025784 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.025956 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.026110 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.026254 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.026415 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.026545 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.026723 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.026861 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.027032 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.027177 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.027338 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.027468 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.027639 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.027769 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.027939 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.028078 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.028261 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.028391 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.028563 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.028693 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.028884 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.029022 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.029196 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.029335 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.029517 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.029645 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.029856 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.029990 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.030162 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.030296 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.030484 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.030641 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.030796 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.030936 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.031078 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.031223 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.031375 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.031516 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.031664 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.031806 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.031982 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.032138 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.032280 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.032418 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.032590 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.032741 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.032905 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.033053 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.033229 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.033392 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.033535 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.033674 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.033875 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.034021 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.034183 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.034349 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.034492 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.034632 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.034785 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.034926 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.035102 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.035299 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.035449 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.035589 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.035729 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.035876 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.036016 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.036164 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.036305 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.036445 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.036592 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.036733 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.036881 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.037032 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.037183 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.037330 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.037472 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.037611 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.037790 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.037954 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.038096 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.038236 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.038375 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.038516 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.038668 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.038810 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.038961 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.039101 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.039240 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.039387 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.040078 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.040229 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.040369 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.040510 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.040649 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.040797 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.040963 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.041120 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.041268 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.041427 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.041569 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.041717 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.041917 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.042059 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.042198 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.042348 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.042524 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.042684 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.042826 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.042965 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.043140 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.043289 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.043439 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.043596 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.043745 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.043886 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.044053 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.044210 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.044359 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.044501 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.044661 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.044811 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.044974 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.045123 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.045271 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.045423 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.045586 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.045737 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.045985 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.046135 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.046285 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.046426 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.046564 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.046711 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.046864 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.047039 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.047197 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.047349 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.047660 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.047815 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.047957 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.048107 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.048269 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.048426 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.048573 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.048720 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.048861 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.049010 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.049151 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.049291 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.049462 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.049612 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.049788 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.049955 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.050098 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.050239 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.050400 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.050550 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.050703 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.050846 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.051028 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.051178 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.051338 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.051486 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.051671 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.051813 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.051953 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.052094 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.052240 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.052382 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.052534 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.052676 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.052885 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.053040 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.053193 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.053342 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.053484 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.053624 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.053805 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.053954 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.054110 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.054252 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.054393 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.054539 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.054679 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.054829 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.054977 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.055238 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.055391 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.055534 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.055933 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.056079 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.056229 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.056372 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.056512 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.056651 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.056790 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.056930 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.057095 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.057242 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.057383 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.057524 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.057670 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.057872 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.058019 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.058160 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.058300 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.058440 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.058604 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.058830 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.058984 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.059124 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.059317 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.059473 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.059637 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.059795 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.060031 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.060187 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.060354 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.060504 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.060677 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.060828 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.060989 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.061149 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.061290 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.061436 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.061615 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.061799 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.061949 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.062089 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.062228 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.062368 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.062523 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.062666 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.062827 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.062977 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.063126 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.063266 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.063418 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.063566 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.063713 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.063855 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.064016 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.064174 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.064322 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.064470 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.064617 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.064766 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.065050 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.065219 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.065371 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.065512 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.065796 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.065950 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.066123 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.066349 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.066494 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.066634 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.066774 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.066914 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.067065 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.067218 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.067366 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.067511 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.067650 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.067792 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.067940 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.068087 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.068234 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.068382 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.068528 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.068676 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.068825 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.068967 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.069116 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.069262 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.069403 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.069567 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.069731 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.069904 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.070045 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.070197 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.070338 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.070487 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.070629 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.070805 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.070965 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.071106 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.071246 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.071394 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.071542 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.071723 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.071881 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.072030 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.072178 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.072332 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.072480 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.072627 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.072768 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.072924 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.073067 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.073215 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.073357 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.073504 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.073651 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.073818 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.073977 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.074130 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.074306 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.074458 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.074600 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.074748 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.074907 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.075049 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.075196 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.075338 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.075476 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.075616 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.075763 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.075904 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.076050 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.076205 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.076346 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.076486 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.076638 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.076790 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.076938 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.077079 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.077227 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.077380 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.077529 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.077670 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.077852 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.077997 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.078144 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.078296 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.078439 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.078580 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.078735 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.078885 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.079204 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.079362 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.079512 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.079653 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.079946 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.080228 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.080380 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.080568 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.080718 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.080899 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.081057 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.081206 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.081347 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.081496 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.081644 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.081829 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.081985 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.082127 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.082276 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.082417 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.082557 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.082696 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.082835 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.082991 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.083145 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.083313 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.083463 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.083612 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.083753 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.083893 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.084045 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.084187 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.084336 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.084588 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.084744 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.084906 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.085047 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.085188 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.085353 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.085502 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.085644 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.085845 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.085996 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.086137 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.086276 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.086985 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.087142 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.087293 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.087445 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.087592 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.087733 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.087897 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.088048 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.088189 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.088339 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.088481 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.088621 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.088795 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.088956 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.089098 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.089248 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.089389 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.089529 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.089731 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.089934 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.090079 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.090219 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.090358 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.090498 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.090732 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.090882 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.091044 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.091201 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.091352 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.091492 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.091672 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.091823 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.091987 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.092130 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.092276 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.092417 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.092586 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.092736 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.092917 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.093065 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.093243 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.093402 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.093544 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.093684 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.093887 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.094056 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.094200 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.094350 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.094505 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.094647 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.094786 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.094926 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.095078 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.095293 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.095437 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.095583 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.095724 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.095864 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.096017 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.096168 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.096309 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.096449 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.096589 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.096728 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.096876 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.097028 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.097176 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.097319 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.097482 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.097632 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.097810 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.097967 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.098108 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.098256 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.098425 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.098587 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.098737 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.098879 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.099035 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.099177 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.099317 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.099457 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.099604 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.099746 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.099907 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.100056 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.100196 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.100345 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.100521 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.100669 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.100841 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.100990 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.101130 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.101279 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.101450 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.101599 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.101785 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.101959 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.102691 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.102846 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.102995 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.103137 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.103288 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.103436 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.103590 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.103732 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.103878 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.104018 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.104158 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.104306 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.104459 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.104607 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.104748 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.104888 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.105028 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.105184 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.105333 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.105474 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.105654 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.105821 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.106006 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.106168 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.106332 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.106482 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.106656 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.106806 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.106998 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.107167 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.107317 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.107458 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.107633 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.107790 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.107956 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.108115 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.108258 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:52:52.108406 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.108612 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.108943 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:52:52.109189 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:52:52.130395 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_db.sqlalchemy.engines [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:52:52.131464 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG oslo_db.sqlalchemy.engines [None req-92303740-6025-4823-b6b0-aa784572970b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:52:52.302467 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.context [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7348e7ae-6880-4f81-9ff6-b2f30a471bee(cell1) {{(pid=100629) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 01:52:52.303418 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.context [None req-92303740-6025-4823-b6b0-aa784572970b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7348e7ae-6880-4f81-9ff6-b2f30a471bee(cell1) {{(pid=100630) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 01:52:52.306949 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:52:52.308010 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG oslo_concurrency.lockutils [None req-92303740-6025-4823-b6b0-aa784572970b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:52:52.308524 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:52:52.309351 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:52:52.309840 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG oslo_concurrency.lockutils [None req-92303740-6025-4823-b6b0-aa784572970b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:52:52.310729 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG oslo_concurrency.lockutils [None req-92303740-6025-4823-b6b0-aa784572970b None None] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:52:52.311310 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:52:52.312812 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG oslo_concurrency.lockutils [None req-92303740-6025-4823-b6b0-aa784572970b None None] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:52:52.322001 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_db.sqlalchemy.engines [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:52:52.324561 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_db.sqlalchemy.engines [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:52:52.328401 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG oslo_db.sqlalchemy.engines [None req-92303740-6025-4823-b6b0-aa784572970b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:52:52.330715 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG oslo_db.sqlalchemy.engines [None req-92303740-6025-4823-b6b0-aa784572970b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:52:52.585643 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG oslo_db.sqlalchemy.engines [None req-92303740-6025-4823-b6b0-aa784572970b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:52:52.588481 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_db.sqlalchemy.engines [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:52:52.932120 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: WARNING keystonemiddleware.auth_token [None req-92303740-6025-4823-b6b0-aa784572970b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:52:52.938661 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: WARNING keystonemiddleware.auth_token [None req-92303740-6025-4823-b6b0-aa784572970b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:52:52.940532 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: WARNING keystonemiddleware.auth_token [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:52:52.951063 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: WARNING keystonemiddleware.auth_token [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:52:53.281525 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: WARNING keystonemiddleware.auth_token [None req-92303740-6025-4823-b6b0-aa784572970b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:52:53.286723 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: WARNING keystonemiddleware.auth_token [None req-92303740-6025-4823-b6b0-aa784572970b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:52:53.292023 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5590ec78e9c0 pid: 100630 (default app) Jan 28 01:52:53.294130 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-92303740-6025-4823-b6b0-aa784572970b None None] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:52:53.295322 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-92303740-6025-4823-b6b0-aa784572970b None None] 10.222.0.77 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001777 Jan 28 01:52:53.295722 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 788 bytes} [Fri Jan 28 01:52:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:52:53.324077 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: WARNING keystonemiddleware.auth_token [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:52:53.331641 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: WARNING keystonemiddleware.auth_token [None req-8d71b176-b2f9-49c8-a12a-61b9752f31f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:52:53.338539 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5590ec78e9c0 pid: 100629 (default app) Jan 28 01:54:12.682191 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-92303740-6025-4823-b6b0-aa784572970b None None] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:12.683194 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-92303740-6025-4823-b6b0-aa784572970b None None] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jan 28 01:54:12.683871 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 2/2] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:13.110455 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-86f6641d-9489-42b8-bb21-328e7cd4a2df admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:13.139082 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-86f6641d-9489-42b8-bb21-328e7cd4a2df admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.448064 Jan 28 01:54:13.139992 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 1/3] 10.222.0.77 () {60 vars in 1291 bytes} [Fri Jan 28 01:54:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:54:15.390591 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-92303740-6025-4823-b6b0-aa784572970b None None] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:15.391622 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-92303740-6025-4823-b6b0-aa784572970b None None] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jan 28 01:54:15.394146 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 3/4] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:54:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:15.452318 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-8184f525-8d91-4fb9-83b5-468cb44147a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "id": "c1"}} {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:15.470267 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:54:15.470267 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: warnings.warn(msg) Jan 28 01:54:15.500091 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-8184f525-8d91-4fb9-83b5-468cb44147a4 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.100107 Jan 28 01:54:15.500817 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 2/5] 10.222.0.77 () {64 vars in 1282 bytes} [Fri Jan 28 01:54:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:54:15.717009 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-2439f6c5-170c-46af-847e-5ac729dc8d74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:15.719314 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:54:15.719314 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: warnings.warn(msg) Jan 28 01:54:15.776459 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-2439f6c5-170c-46af-847e-5ac729dc8d74 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.267098 Jan 28 01:54:15.781788 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 4/6] 10.222.0.77 () {64 vars in 1335 bytes} [Fri Jan 28 01:54:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:54:17.997139 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-8184f525-8d91-4fb9-83b5-468cb44147a4 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:17.998247 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-8184f525-8d91-4fb9-83b5-468cb44147a4 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jan 28 01:54:17.998655 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 3/7] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:54:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:18.103717 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-a4a404d3-19ed-4148-a1ca-b15361115491 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:18.121536 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:54:18.121536 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: warnings.warn(msg) Jan 28 01:54:18.139245 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-a4a404d3-19ed-4148-a1ca-b15361115491 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134140 Jan 28 01:54:18.139804 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 5/8] 10.222.0.77 () {64 vars in 1282 bytes} [Fri Jan 28 01:54:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:54:18.152102 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-9212a03a-8cb8-4d33-b0b5-6f2340ab4ddd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:18.153554 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:54:18.153554 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: warnings.warn(msg) Jan 28 01:54:18.185218 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-9212a03a-8cb8-4d33-b0b5-6f2340ab4ddd admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036723 Jan 28 01:54:18.185994 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 4/9] 10.222.0.77 () {64 vars in 1335 bytes} [Fri Jan 28 01:54:18 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:54:20.409888 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-a4a404d3-19ed-4148-a1ca-b15361115491 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:20.411150 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-a4a404d3-19ed-4148-a1ca-b15361115491 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001746 Jan 28 01:54:20.411921 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 6/10] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:54:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:20.472677 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-602e3f51-d9d0-4788-95eb-0f72e8589ddc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:20.493022 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-602e3f51-d9d0-4788-95eb-0f72e8589ddc admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074315 Jan 28 01:54:20.493666 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 5/11] 10.222.0.77 () {64 vars in 1282 bytes} [Fri Jan 28 01:54:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:54:20.506458 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-4ba888c8-7b8d-4f89-b8d5-91868398a256 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:20.529168 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-4ba888c8-7b8d-4f89-b8d5-91868398a256 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026455 Jan 28 01:54:20.530035 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 7/12] 10.222.0.77 () {64 vars in 1335 bytes} [Fri Jan 28 01:54:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:54:22.765703 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-602e3f51-d9d0-4788-95eb-0f72e8589ddc admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:22.766738 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-602e3f51-d9d0-4788-95eb-0f72e8589ddc admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jan 28 01:54:22.767142 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 6/13] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:54:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:22.826437 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-a2d1e280-f2b3-4895-86e2-cbad9b993ff6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "id": "d3"}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:22.843893 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-a2d1e280-f2b3-4895-86e2-cbad9b993ff6 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070153 Jan 28 01:54:22.844438 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 8/14] 10.222.0.77 () {64 vars in 1282 bytes} [Fri Jan 28 01:54:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:54:22.856669 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-34daa637-21d3-45d4-9a97-c81c77133cf8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:22.880871 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-34daa637-21d3-45d4-9a97-c81c77133cf8 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027835 Jan 28 01:54:22.881452 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 7/15] 10.222.0.77 () {64 vars in 1335 bytes} [Fri Jan 28 01:54:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:54:25.134507 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-a2d1e280-f2b3-4895-86e2-cbad9b993ff6 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:25.135516 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-a2d1e280-f2b3-4895-86e2-cbad9b993ff6 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jan 28 01:54:25.135920 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 9/16] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:54:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:25.199024 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-4c79fe53-e4aa-4183-843d-563c18395311 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20}} {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:25.220184 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-4c79fe53-e4aa-4183-843d-563c18395311 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077661 Jan 28 01:54:25.220943 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 8/17] 10.222.0.77 () {64 vars in 1282 bytes} [Fri Jan 28 01:54:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:54:25.233182 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-1ab0eacd-244a-4588-8515-e752f65bd2ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:25.260086 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-1ab0eacd-244a-4588-8515-e752f65bd2ea admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030448 Jan 28 01:54:25.270889 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 10/18] 10.222.0.77 () {64 vars in 1335 bytes} [Fri Jan 28 01:54:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:54:27.485686 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-4c79fe53-e4aa-4183-843d-563c18395311 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:27.486662 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-4c79fe53-e4aa-4183-843d-563c18395311 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jan 28 01:54:27.487374 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 9/19] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:54:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:27.549255 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-861d6271-a552-4a74-a275-9d96e1c6cbd8 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:27.574364 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-861d6271-a552-4a74-a275-9d96e1c6cbd8 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079850 Jan 28 01:54:27.575123 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 11/20] 10.222.0.77 () {60 vars in 1291 bytes} [Fri Jan 28 01:54:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:54:30.657201 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-4c79fe53-e4aa-4183-843d-563c18395311 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:30.658239 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-4c79fe53-e4aa-4183-843d-563c18395311 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jan 28 01:54:30.658635 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 10/21] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:54:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:30.717630 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-5613abe2-2c16-4383-b0fa-06e37249f219 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:30.738118 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-5613abe2-2c16-4383-b0fa-06e37249f219 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072577 Jan 28 01:54:30.738662 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 12/22] 10.222.0.77 () {64 vars in 1282 bytes} [Fri Jan 28 01:54:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:54:30.751077 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-9191b39d-4f60-425b-8374-a1a897ad0890 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:30.772807 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-9191b39d-4f60-425b-8374-a1a897ad0890 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025325 Jan 28 01:54:30.773382 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 11/23] 10.222.0.77 () {64 vars in 1332 bytes} [Fri Jan 28 01:54:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:54:33.646118 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-5613abe2-2c16-4383-b0fa-06e37249f219 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:33.647127 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-5613abe2-2c16-4383-b0fa-06e37249f219 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jan 28 01:54:33.647670 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 13/24] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:54:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:33.707052 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-e66973c3-96ef-496a-b915-a177f45006bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1}} {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:33.724940 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-e66973c3-96ef-496a-b915-a177f45006bc admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070949 Jan 28 01:54:33.725515 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 12/25] 10.222.0.77 () {64 vars in 1282 bytes} [Fri Jan 28 01:54:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:54:33.738256 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-cebcdb47-5c50-42f6-bc1c-31498d1c14ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:33.760981 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-cebcdb47-5c50-42f6-bc1c-31498d1c14ea admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026329 Jan 28 01:54:33.761554 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 14/26] 10.222.0.77 () {64 vars in 1332 bytes} [Fri Jan 28 01:54:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:54:35.992008 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-e66973c3-96ef-496a-b915-a177f45006bc admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:35.993039 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-e66973c3-96ef-496a-b915-a177f45006bc admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jan 28 01:54:35.993444 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 13/27] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:54:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:36.049554 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-5c1df25c-0906-4c2a-99f4-b0c50baf10ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3"}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:36.067201 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-5c1df25c-0906-4c2a-99f4-b0c50baf10ea admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.067040 Jan 28 01:54:36.067736 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 15/28] 10.222.0.77 () {64 vars in 1282 bytes} [Fri Jan 28 01:54:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:54:36.082334 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-f2b99e4f-4532-41d4-bb72-383120e333d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:36.105197 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-f2b99e4f-4532-41d4-bb72-383120e333d6 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026431 Jan 28 01:54:36.105776 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 14/29] 10.222.0.77 () {64 vars in 1332 bytes} [Fri Jan 28 01:54:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:54:38.343081 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-5c1df25c-0906-4c2a-99f4-b0c50baf10ea admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:38.344633 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-5c1df25c-0906-4c2a-99f4-b0c50baf10ea admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 Jan 28 01:54:38.345206 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 16/30] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:54:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:38.410808 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-45fa6398-211e-472e-ba44-5699be759a14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "disk": 80, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "vcpus": 4}} {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:38.433142 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-45fa6398-211e-472e-ba44-5699be759a14 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081594 Jan 28 01:54:38.434742 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 15/31] 10.222.0.77 () {64 vars in 1282 bytes} [Fri Jan 28 01:54:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:54:38.446774 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-01f33022-8f97-43c9-81a4-cea2c0e27335 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:38.471265 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-01f33022-8f97-43c9-81a4-cea2c0e27335 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028583 Jan 28 01:54:38.471843 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 17/32] 10.222.0.77 () {64 vars in 1332 bytes} [Fri Jan 28 01:54:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:54:40.702603 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-45fa6398-211e-472e-ba44-5699be759a14 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:40.702603 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-45fa6398-211e-472e-ba44-5699be759a14 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jan 28 01:54:40.705579 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 16/33] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:40.773305 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-facb7afa-aec4-486c-9583-17af826f9149 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:40.792203 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-facb7afa-aec4-486c-9583-17af826f9149 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.083216 Jan 28 01:54:40.793102 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 18/34] 10.222.0.77 () {64 vars in 1282 bytes} [Fri Jan 28 01:54:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:54:40.805619 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-95de6156-c94f-4984-93a9-7e5fb872a1dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:54:40.831411 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-95de6156-c94f-4984-93a9-7e5fb872a1dd admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029828 Jan 28 01:54:40.832250 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 17/35] 10.222.0.77 () {64 vars in 1332 bytes} [Fri Jan 28 01:54:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:55:19.053212 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-facb7afa-aec4-486c-9583-17af826f9149 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:19.054272 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-facb7afa-aec4-486c-9583-17af826f9149 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jan 28 01:55:19.054669 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 19/36] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:55:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:55:19.110989 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-9cca45d0-8516-485d-abae-48e23e17372f admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:19.127347 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-9cca45d0-8516-485d-abae-48e23e17372f admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.065880 Jan 28 01:55:19.127883 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 18/37] 10.222.0.77 () {60 vars in 1291 bytes} [Fri Jan 28 01:55:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:55:20.568321 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-facb7afa-aec4-486c-9583-17af826f9149 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:20.569331 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-facb7afa-aec4-486c-9583-17af826f9149 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jan 28 01:55:20.569730 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 20/38] 10.222.0.77 () {56 vars in 1074 bytes} [Fri Jan 28 01:55:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:55:20.760167 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-86dff47c-c046-49c2-b9c5-9dc5a1883c63 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:20.765504 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.wsgi [None req-86dff47c-c046-49c2-b9c5-9dc5a1883c63 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 01:55:20.766110 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-86dff47c-c046-49c2-b9c5-9dc5a1883c63 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:55:20.766907 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-86dff47c-c046-49c2-b9c5-9dc5a1883c63 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056695 Jan 28 01:55:20.767407 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 19/39] 10.222.0.77 () {60 vars in 1190 bytes} [Fri Jan 28 01:55:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:20.777734 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-1f9b58bf-5a1c-43f6-863b-8c53a4831e27 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:20.798012 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-1f9b58bf-5a1c-43f6-863b-8c53a4831e27 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024295 Jan 28 01:55:20.798555 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 21/40] 10.222.0.77 () {60 vars in 1210 bytes} [Fri Jan 28 01:55:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:55:20.808600 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-4258f964-9d7d-45c3-8080-753978addcb9 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:20.829835 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-4258f964-9d7d-45c3-8080-753978addcb9 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024649 Jan 28 01:55:20.830362 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 20/41] 10.222.0.77 () {60 vars in 1210 bytes} [Fri Jan 28 01:55:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:55:20.840411 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-8476c53c-419f-48ff-b3ab-302e2d6a45f2 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:20.845592 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.wsgi [None req-8476c53c-419f-48ff-b3ab-302e2d6a45f2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 01:55:20.846178 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-8476c53c-419f-48ff-b3ab-302e2d6a45f2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:55:20.846953 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-8476c53c-419f-48ff-b3ab-302e2d6a45f2 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010005 Jan 28 01:55:20.847430 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 22/42] 10.222.0.77 () {60 vars in 1190 bytes} [Fri Jan 28 01:55:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:22.250582 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-4258f964-9d7d-45c3-8080-753978addcb9 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:22.251620 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-4258f964-9d7d-45c3-8080-753978addcb9 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Jan 28 01:55:22.252013 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 21/43] 10.222.0.77 () {56 vars in 1074 bytes} [Fri Jan 28 01:55:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:55:22.442637 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-39deeafa-3b99-4deb-b24b-0f765968ae4d admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:22.448464 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.wsgi [None req-39deeafa-3b99-4deb-b24b-0f765968ae4d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 01:55:22.449017 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-39deeafa-3b99-4deb-b24b-0f765968ae4d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:55:22.449821 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-39deeafa-3b99-4deb-b24b-0f765968ae4d admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058220 Jan 28 01:55:22.450325 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 23/44] 10.222.0.77 () {60 vars in 1190 bytes} [Fri Jan 28 01:55:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:22.460268 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-8fd96c07-2eec-4b04-9f05-12924b76e6a2 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:22.473188 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-8fd96c07-2eec-4b04-9f05-12924b76e6a2 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016616 Jan 28 01:55:22.473696 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 22/45] 10.222.0.77 () {60 vars in 1210 bytes} [Fri Jan 28 01:55:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:55:22.483083 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-bf9fd827-202e-4dcd-970c-b45e6ce7bfef admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:22.496537 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-bf9fd827-202e-4dcd-970c-b45e6ce7bfef admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016742 Jan 28 01:55:22.497045 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 24/46] 10.222.0.77 () {60 vars in 1210 bytes} [Fri Jan 28 01:55:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:55:22.506240 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-f3d3f020-95aa-43fa-86d3-6b1693edf4f2 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:22.511753 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.wsgi [None req-f3d3f020-95aa-43fa-86d3-6b1693edf4f2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 01:55:22.512300 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-f3d3f020-95aa-43fa-86d3-6b1693edf4f2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:55:22.513067 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-f3d3f020-95aa-43fa-86d3-6b1693edf4f2 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010187 Jan 28 01:55:22.513538 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 23/47] 10.222.0.77 () {60 vars in 1190 bytes} [Fri Jan 28 01:55:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:23.858283 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-bf9fd827-202e-4dcd-970c-b45e6ce7bfef admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:23.859269 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-bf9fd827-202e-4dcd-970c-b45e6ce7bfef admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jan 28 01:55:23.859693 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 25/48] 10.222.0.77 () {56 vars in 1074 bytes} [Fri Jan 28 01:55:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:55:24.047522 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-ae5b2be4-5179-4e7b-b7e0-87c6ed9c2409 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:24.053122 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.wsgi [None req-ae5b2be4-5179-4e7b-b7e0-87c6ed9c2409 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 01:55:24.053684 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-ae5b2be4-5179-4e7b-b7e0-87c6ed9c2409 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:55:24.054505 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-ae5b2be4-5179-4e7b-b7e0-87c6ed9c2409 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057024 Jan 28 01:55:24.055030 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 24/49] 10.222.0.77 () {60 vars in 1193 bytes} [Fri Jan 28 01:55:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:24.065077 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-1e93de48-eaf5-43c5-8a54-7f8956f5019d admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:24.078278 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-1e93de48-eaf5-43c5-8a54-7f8956f5019d admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016937 Jan 28 01:55:24.078740 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 26/50] 10.222.0.77 () {60 vars in 1210 bytes} [Fri Jan 28 01:55:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:55:24.088633 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:24.101438 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016623 Jan 28 01:55:24.102513 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 25/51] 10.222.0.77 () {60 vars in 1210 bytes} [Fri Jan 28 01:55:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:55:24.111830 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-f446aea4-bf6c-41e0-bb9a-9b79a29934b6 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:24.116674 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.wsgi [None req-f446aea4-bf6c-41e0-bb9a-9b79a29934b6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 01:55:24.117265 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-f446aea4-bf6c-41e0-bb9a-9b79a29934b6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:55:24.118066 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-f446aea4-bf6c-41e0-bb9a-9b79a29934b6 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009608 Jan 28 01:55:24.118543 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 27/52] 10.222.0.77 () {60 vars in 1193 bytes} [Fri Jan 28 01:55:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 28 01:55:25.488439 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:25.489434 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jan 28 01:55:25.489849 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 26/53] 10.222.0.77 () {56 vars in 1074 bytes} [Fri Jan 28 01:55:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:55:25.681650 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-dda81b61-d4ad-40a5-9801-6c1fcf28dcb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:55:25.698817 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-dda81b61-d4ad-40a5-9801-6c1fcf28dcb7 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069062 Jan 28 01:55:25.699357 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 28/54] 10.222.0.77 () {64 vars in 1235 bytes} [Fri Jan 28 01:55:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:55:27.055776 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:27.056757 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002018 Jan 28 01:55:27.057149 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 27/55] 10.222.0.77 () {56 vars in 1074 bytes} [Fri Jan 28 01:55:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:55:27.250077 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-cca54afc-88de-471d-bc5a-aa80d1d55a02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:55:27.268583 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-cca54afc-88de-471d-bc5a-aa80d1d55a02 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068202 Jan 28 01:55:27.269487 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 29/56] 10.222.0.77 () {64 vars in 1235 bytes} [Fri Jan 28 01:55:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:55:28.631451 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:28.632710 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001841 Jan 28 01:55:28.633668 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 28/57] 10.222.0.77 () {56 vars in 1074 bytes} [Fri Jan 28 01:55:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:55:28.823740 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-14f93937-f9e5-4774-b61f-3ac210cbf35a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:55:28.841157 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-14f93937-f9e5-4774-b61f-3ac210cbf35a admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068231 Jan 28 01:55:28.841632 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 30/58] 10.222.0.77 () {64 vars in 1235 bytes} [Fri Jan 28 01:55:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:55:30.202556 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:30.203548 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 28 01:55:30.203968 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 29/59] 10.222.0.77 () {56 vars in 1074 bytes} [Fri Jan 28 01:55:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:55:30.398889 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-61f804fd-dad6-4a40-9b58-e23b0d4bbf35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:55:30.415812 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-61f804fd-dad6-4a40-9b58-e23b0d4bbf35 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067089 Jan 28 01:55:30.416326 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 31/60] 10.222.0.77 () {64 vars in 1235 bytes} [Fri Jan 28 01:55:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:55:31.783821 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:31.784831 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jan 28 01:55:31.785234 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 30/61] 10.222.0.77 () {56 vars in 1074 bytes} [Fri Jan 28 01:55:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:55:31.982934 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-80c86019-c1ed-4173-9146-fbd49a8c4798 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:55:32.002101 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-80c86019-c1ed-4173-9146-fbd49a8c4798 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068828 Jan 28 01:55:32.002562 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 32/62] 10.222.0.77 () {60 vars in 1202 bytes} [Fri Jan 28 01:55:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:56:12.654572 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:12.655562 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-dad5d8a8-953e-4c97-9bbc-ed6f9aa5e14e admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jan 28 01:56:12.655955 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 31/63] 10.222.0.77 () {54 vars in 930 bytes} [Fri Jan 28 01:56:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:12.712496 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-c77ad47f-7652-4800-8723-59ea54a9ab11 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:12.730973 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-c77ad47f-7652-4800-8723-59ea54a9ab11 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068498 Jan 28 01:56:12.731493 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 33/64] 10.222.0.77 () {60 vars in 1291 bytes} [Fri Jan 28 01:56:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:56:12.753821 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-a617de36-ab4f-4e4b-b704-eb21b046f295 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:12.761857 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-a617de36-ab4f-4e4b-b704-eb21b046f295 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011503 Jan 28 01:56:12.762357 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 32/65] 10.222.0.77 () {60 vars in 1282 bytes} [Fri Jan 28 01:56:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:56:12.773824 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-e01702f8-4aee-4ed8-bbb4-ebdb1a65e230 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:12.781137 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-e01702f8-4aee-4ed8-bbb4-ebdb1a65e230 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010823 Jan 28 01:56:12.781639 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 34/66] 10.222.0.77 () {60 vars in 1285 bytes} [Fri Jan 28 01:56:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:56:12.792733 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-36b3f833-dd74-4ce6-b7ba-f2ee5bc74973 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:12.799850 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-36b3f833-dd74-4ce6-b7ba-f2ee5bc74973 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010351 Jan 28 01:56:12.800353 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 33/67] 10.222.0.77 () {60 vars in 1285 bytes} [Fri Jan 28 01:56:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:56:12.812451 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-683b7b70-8c8c-4159-8c11-3c14c5e0dc05 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:12.820340 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-683b7b70-8c8c-4159-8c11-3c14c5e0dc05 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011455 Jan 28 01:56:12.820845 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 35/68] 10.222.0.77 () {60 vars in 1282 bytes} [Fri Jan 28 01:56:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:38.556738 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-7e611ee4-c5de-41a0-bc19-58f1f4b4f350 tempest-verify_tempest_config-1993910604 tempest-verify_tempest_config-1993910604-project] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:38.558707 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-7e611ee4-c5de-41a0-bc19-58f1f4b4f350 tempest-verify_tempest_config-1993910604 tempest-verify_tempest_config-1993910604-project] 10.222.0.77 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107946 Jan 28 01:57:38.559486 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 34/69] 10.222.0.77 () {58 vars in 1133 bytes} [Fri Jan 28 01:57:38 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:59:10.248371 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-683b7b70-8c8c-4159-8c11-3c14c5e0dc05 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:10.249369 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-683b7b70-8c8c-4159-8c11-3c14c5e0dc05 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jan 28 01:59:10.249777 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 36/70] 10.222.0.77 () {56 vars in 1074 bytes} [Fri Jan 28 01:59:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:10.496177 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-fb68bdec-c6f3-4271-810c-f16a33c79554 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:10.497344 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:10.497344 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: warnings.warn(msg) Jan 28 01:59:10.498925 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-fb68bdec-c6f3-4271-810c-f16a33c79554 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:10.499368 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-fb68bdec-c6f3-4271-810c-f16a33c79554 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:10.500142 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-fb68bdec-c6f3-4271-810c-f16a33c79554 admin admin] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:10.500565 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-fb68bdec-c6f3-4271-810c-f16a33c79554 admin admin] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:10.533242 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-fb68bdec-c6f3-4271-810c-f16a33c79554 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.146220 Jan 28 01:59:10.533802 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 35/71] 10.222.0.77 () {60 vars in 1193 bytes} [Fri Jan 28 01:59:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:59:11.907912 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-683b7b70-8c8c-4159-8c11-3c14c5e0dc05 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:11.908915 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-683b7b70-8c8c-4159-8c11-3c14c5e0dc05 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jan 28 01:59:11.909315 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 37/72] 10.222.0.77 () {56 vars in 1074 bytes} [Fri Jan 28 01:59:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:12.098981 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-429acb74-8a61-4a21-bb0b-33689556e830 admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:12.100124 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:12.100124 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: warnings.warn(msg) Jan 28 01:59:12.101624 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-429acb74-8a61-4a21-bb0b-33689556e830 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:12.102098 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-429acb74-8a61-4a21-bb0b-33689556e830 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:12.102881 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-429acb74-8a61-4a21-bb0b-33689556e830 admin admin] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:12.103303 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-429acb74-8a61-4a21-bb0b-33689556e830 admin admin] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:12.123311 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-429acb74-8a61-4a21-bb0b-33689556e830 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075736 Jan 28 01:59:12.123865 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 36/73] 10.222.0.77 () {60 vars in 1193 bytes} [Fri Jan 28 01:59:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:59:23.930424 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-683b7b70-8c8c-4159-8c11-3c14c5e0dc05 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:23.931432 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-683b7b70-8c8c-4159-8c11-3c14c5e0dc05 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jan 28 01:59:23.931821 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 38/74] 10.222.0.77 () {56 vars in 1074 bytes} [Fri Jan 28 01:59:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:24.119761 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-3e6bb89f-9104-4055-97d3-1d3e012be78a admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:24.120901 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:24.120901 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: warnings.warn(msg) Jan 28 01:59:24.122452 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-3e6bb89f-9104-4055-97d3-1d3e012be78a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:24.122889 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-3e6bb89f-9104-4055-97d3-1d3e012be78a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:24.123662 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-3e6bb89f-9104-4055-97d3-1d3e012be78a admin admin] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:24.124114 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-3e6bb89f-9104-4055-97d3-1d3e012be78a admin admin] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:24.149532 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-3e6bb89f-9104-4055-97d3-1d3e012be78a admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079729 Jan 28 01:59:24.150012 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 37/75] 10.222.0.77 () {60 vars in 1193 bytes} [Fri Jan 28 01:59:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:25.516694 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: DEBUG nova.api.openstack.wsgi [None req-683b7b70-8c8c-4159-8c11-3c14c5e0dc05 admin admin] Calling method '>' {{(pid=100630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:25.517685 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: INFO nova.api.openstack.requestlog [None req-683b7b70-8c8c-4159-8c11-3c14c5e0dc05 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jan 28 01:59:25.518127 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: [pid: 100630|app: 0|req: 39/76] 10.222.0.77 () {56 vars in 1074 bytes} [Fri Jan 28 01:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:25.710060 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG nova.api.openstack.wsgi [None req-4cc0d61c-0e35-4a73-b9a1-d0c48ec7bf1d admin admin] Calling method '>' {{(pid=100629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:25.711202 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:25.711202 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: warnings.warn(msg) Jan 28 01:59:25.712691 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-4cc0d61c-0e35-4a73-b9a1-d0c48ec7bf1d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:25.713129 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-4cc0d61c-0e35-4a73-b9a1-d0c48ec7bf1d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:25.713953 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-4cc0d61c-0e35-4a73-b9a1-d0c48ec7bf1d admin admin] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:25.714374 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: DEBUG oslo_concurrency.lockutils [None req-4cc0d61c-0e35-4a73-b9a1-d0c48ec7bf1d admin admin] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:25.734753 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: INFO nova.api.openstack.requestlog [None req-4cc0d61c-0e35-4a73-b9a1-d0c48ec7bf1d admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075171 Jan 28 01:59:25.735279 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: [pid: 100629|app: 0|req: 38/77] 10.222.0.77 () {60 vars in 1193 bytes} [Fri Jan 28 01:59:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:22.677714 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: Fri Jan 28 02:00:22 2022 - graceful shutdown triggered... Jan 28 02:00:22.677869 dv-cinder-824979-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 28 02:00:22.678770 dv-cinder-824979-1-iscsi devstack@n-api.service[100629]: Gracefully killing worker 1 (pid: 100629)... Jan 28 02:00:22.679171 dv-cinder-824979-1-iscsi devstack@n-api.service[100630]: Gracefully killing worker 2 (pid: 100630)... Jan 28 02:00:23.679109 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: worker 1 buried after 1 seconds Jan 28 02:00:23.679587 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: worker 2 buried after 1 seconds Jan 28 02:00:23.679587 dv-cinder-824979-1-iscsi devstack@n-api.service[100628]: goodbye to uWSGI. Jan 28 02:00:23.680699 dv-cinder-824979-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 28 02:00:23.681243 dv-cinder-824979-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 28 02:00:23.684100 dv-cinder-824979-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 02:00:23.694525 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 02:00:23.697263 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 02:00:23 2022] *** Jan 28 02:00:23.697263 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 02:00:23.697263 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 02:00:23.697263 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: nodename: dv-cinder-824979-1-iscsi Jan 28 02:00:23.697263 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: machine: x86_64 Jan 28 02:00:23.697263 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: clock source: unix Jan 28 02:00:23.697263 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: pcre jit disabled Jan 28 02:00:23.697263 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: detected number of CPU cores: 4 Jan 28 02:00:23.697263 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: current working directory: / Jan 28 02:00:23.697263 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: detected binary path: /usr/bin/uwsgi-core Jan 28 02:00:23.698015 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: your processes number limit is 47680 Jan 28 02:00:23.698015 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: your memory page size is 4096 bytes Jan 28 02:00:23.698015 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: detected max file descriptor number: 2048 Jan 28 02:00:23.698015 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: lock engine: pthread robust mutexes Jan 28 02:00:23.698015 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: thunder lock: enabled Jan 28 02:00:23.698015 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 02:00:23.698015 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 02:00:23.743024 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: Python main interpreter initialized at 0x55752d5959c0 Jan 28 02:00:23.743024 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: python threads support enabled Jan 28 02:00:23.743024 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: your server socket listen backlog is limited to 100 connections Jan 28 02:00:23.743024 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: your mercy for graceful operations on workers is 90 seconds Jan 28 02:00:23.743456 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 02:00:23.743456 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: *** Operational MODE: preforking *** Jan 28 02:00:23.743735 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: *** uWSGI is running in multiple interpreter mode *** Jan 28 02:00:23.743735 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: spawned uWSGI master process (pid: 115738) Jan 28 02:00:23.743876 dv-cinder-824979-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 02:00:23.749833 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: spawned uWSGI worker 1 (pid: 115760, cores: 1) Jan 28 02:00:23.749833 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: spawned uWSGI worker 2 (pid: 115761, cores: 1) Jan 28 02:00:23.749833 dv-cinder-824979-1-iscsi devstack@n-api.service[115738]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 02:00:25.568077 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 02:00:25.568077 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: from cryptography.utils import int_from_bytes Jan 28 02:00:25.569397 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 02:00:25.569397 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: from cryptography.utils import int_from_bytes Jan 28 02:00:25.584263 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 02:00:25.584263 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: from cryptography.utils import int_from_bytes Jan 28 02:00:25.584871 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 02:00:25.584871 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: from cryptography.utils import int_from_bytes Jan 28 02:00:28.176294 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 02:00:28.176857 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 02:00:28.177147 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 02:00:28.177393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 02:00:28.177664 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 02:00:28.178063 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.178396 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.178718 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.179042 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.179372 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.179683 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.180006 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.180326 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.180654 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.180916 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.181234 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.181562 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824979-1-iscsi {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.181903 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.182216 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.182525 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.182844 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.183147 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.183469 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.183775 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.184283 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.186042 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.186042 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.186042 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.186042 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.186391 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.186617 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.186871 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.187192 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.187514 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.187820 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.188249 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824979-1-iscsi {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.188579 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.188890 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.189200 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.189867 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.190183 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.190507 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.190819 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.191144 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.191471 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.191782 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.192105 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.192424 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.192747 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.193043 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.193349 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.193662 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.194002 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.194309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.194616 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.194864 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.195172 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.195507 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.195810 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.196130 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.196402 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.196651 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.196969 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.197288 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.197593 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.197923 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.198229 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.198531 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.198835 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.199140 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.199443 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.199749 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.200066 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.200380 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.200701 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.201005 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.201592 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.201792 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.201983 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.202297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.202634 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.202951 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.203257 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.203576 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.203898 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.204201 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.204508 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.204818 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.205652 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.206000 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.206309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.206560 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.206861 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.207169 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.207486 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.207791 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.208097 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.208404 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.208708 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.209013 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.209321 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.209624 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.209965 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.210274 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.210581 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.210890 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.211196 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.211500 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.211815 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.212134 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.212447 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.212753 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.213061 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.213378 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.213698 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.214031 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.214348 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.214643 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.214949 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.215259 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.215573 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.215853 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 02:00:28.216348 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.216505 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 02:00:28.216650 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.216650 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.216928 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 02:00:28.217082 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.217235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 02:00:28.217389 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.217538 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 02:00:28.217701 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.217889 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.218059 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.218214 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.218376 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.218556 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.218728 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.218892 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.219047 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.219201 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.219499 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.219652 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.219795 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.219795 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.220177 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.220361 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.220624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.221389 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.221559 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.221849 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.222006 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.222242 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.222437 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.222692 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.222959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824979-1-iscsi {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.223154 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.223346 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.223638 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.223791 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.223992 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.224267 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.224451 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.224635 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.224833 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.225023 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.225023 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.225399 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.225589 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.225798 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.225798 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.226177 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.226406 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.226600 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.226782 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.226962 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.227142 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.227330 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.227527 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.227714 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.227906 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.228088 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.228277 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.228475 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.228675 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.228873 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.229053 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.229232 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.229431 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.229804 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.229975 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.230131 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.230367 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.230527 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824979-1-iscsi {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.230759 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.230923 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.231075 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.231239 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.231390 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.231635 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.231831 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.231831 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.232299 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.232537 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.232795 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.232987 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.233242 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.233427 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.233609 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.233969 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.234173 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.234434 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.234620 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.234813 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.235052 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.235235 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.235415 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.235610 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.235791 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.235978 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.236182 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.236375 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.236569 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.236759 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.236978 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.237162 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.237343 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.237532 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.237730 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.237958 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.238151 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.238332 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.238523 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.238712 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.238918 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.239108 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.239299 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.239479 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.239659 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.240032 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.240228 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.240431 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.240729 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.241003 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.241186 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.241186 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.241552 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.241714 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.241959 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.242161 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.242424 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.242585 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.242730 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.242979 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.243139 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.243379 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.243539 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.243697 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.243841 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.244118 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.244270 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.244270 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.244664 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.244827 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.244972 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.245114 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.245255 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.245397 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.245550 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.245704 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.245873 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.246029 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.246183 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.246326 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.246482 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.246628 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.246770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.246912 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.247062 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.247214 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.247367 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.247510 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.247661 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.247809 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.247970 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.248129 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.248274 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.248423 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.248566 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.255506 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.255725 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.255904 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.256063 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.256228 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.256392 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.256540 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.256699 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.256947 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.257104 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.257259 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.257404 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.258049 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.258209 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.258369 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.258514 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.258705 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.258854 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.259005 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.259159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.259313 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.259469 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.259612 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.259754 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.259904 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.260062 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.260215 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.260417 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.260568 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.260721 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.260864 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.261853 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.262034 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.262190 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.262351 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.262495 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.262646 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.262797 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.262955 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.263107 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.263271 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.263418 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.263562 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.263711 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.263869 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.264119 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.264288 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.264444 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.264588 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.264739 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.264928 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.265631 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.271630 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.272467 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.272628 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.272800 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.272959 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.273107 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.273275 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.273428 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.273583 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.273739 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.273945 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.274125 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.274284 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.274730 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.274897 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.275043 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.275225 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.275411 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.276632 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.276810 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.276965 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.277120 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.277341 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.277537 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.277697 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.277902 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.278061 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.278219 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.278368 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.278521 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.278668 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.278820 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.278820 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.279107 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.279252 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.279777 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.279933 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.280078 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.280236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.280389 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.280547 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.281438 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.281597 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.281928 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.282274 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.282463 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.282612 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.282755 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.282898 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.283107 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.283752 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.283907 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.284052 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.284204 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.284350 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.284492 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.284653 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.284901 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.285072 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.285225 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.285371 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.285513 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.285674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.286274 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.286468 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:00:28.286889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.287042 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.287186 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.287345 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.287498 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.287662 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.287815 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.287958 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.288110 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.288272 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.288423 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.288576 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.288728 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.288881 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.289033 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.289186 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.289338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.289490 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.289655 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.289869 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.290106 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.290271 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.290416 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.290559 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.290704 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.290846 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.290998 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.291149 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.291292 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.291292 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.291573 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.291728 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.291953 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.292107 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.292251 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.292393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.292543 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.292695 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.292853 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.293006 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.293151 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.293301 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.293445 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.293597 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.293773 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.293994 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.294160 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.294314 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.294458 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.294616 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.294760 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.294929 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.295164 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.295326 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.295472 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.295625 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.295784 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.295954 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.296450 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.296618 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.296883 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.297203 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.297358 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.297502 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.297502 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.297805 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.297957 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.298114 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.298266 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.298427 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.298571 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.298750 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.298905 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.299059 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.299212 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.299356 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.299507 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.299651 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.299813 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.299966 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.300119 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.300270 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.300424 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.300574 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.300731 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.300874 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.301025 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.301176 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.301321 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.301463 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.301619 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.301816 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.301968 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.302112 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.302276 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.302688 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.302848 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.302993 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.303144 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.303289 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.303440 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.303593 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.303745 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.303895 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.304046 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.304197 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.304348 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.304511 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.304663 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.304814 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.304964 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.305132 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.305356 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.305525 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.305679 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.305929 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.306091 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.306591 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.306761 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.306988 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.307344 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.307501 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.307501 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.307782 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.307941 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.308095 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.308246 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.308403 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.308556 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.308700 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.308853 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.308997 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.309142 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.309303 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.309455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.309885 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.310057 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.310210 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.310353 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.310950 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.311096 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.311241 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.311373 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.311513 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.311647 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.311786 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.311917 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.312057 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.312189 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.312328 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.312459 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.312597 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.312729 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.312869 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.313015 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.313155 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.313287 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.313426 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.313565 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.313706 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.313855 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.313999 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.314137 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.314293 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.314436 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.314568 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.314708 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.314851 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.314991 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.315129 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.315260 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.315483 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.315628 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.315769 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.315913 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.316045 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.316183 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.316329 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.316789 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.316929 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.317150 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.317295 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.317608 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.317761 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.317895 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.318041 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.318181 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.318323 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.318455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.318594 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.318724 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.318864 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.318996 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.319134 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.319265 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.319397 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.319527 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.319667 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.319805 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.319945 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.320075 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.320213 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.320352 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.320492 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.320630 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.320768 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.320907 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.321046 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.321260 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.321393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.321538 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.321852 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.322002 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.322137 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.322290 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.322495 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.322641 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.322784 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.322915 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.323052 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.323052 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.323328 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.323467 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.323606 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.323744 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.323883 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.324026 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.324166 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.324305 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.324436 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.324575 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.324716 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.324856 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.324988 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.325117 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.325249 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.325387 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.325621 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.325780 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.325926 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.326057 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.326195 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.326333 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.326472 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.326928 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.327122 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.327325 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.327461 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.327606 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.327913 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.328056 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.328188 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.328333 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.328475 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.328615 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.328747 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.328884 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.329016 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.329152 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.329290 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.329437 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.329569 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.329699 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.329856 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.330503 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.330645 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.330787 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.330927 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.331058 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.331199 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.331338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.331477 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.331617 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.331749 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.331878 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.331878 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.332133 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.332277 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.332407 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.332591 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.332734 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.332866 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.333003 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.333143 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.333274 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.333412 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.333543 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.333682 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.333884 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.334314 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.334455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.334594 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.334735 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.334876 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.335007 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.335151 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.335291 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.335429 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.335560 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.335780 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.335926 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.336059 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.336204 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.336342 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.336479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.336610 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.337090 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.337227 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.337432 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.337573 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.337702 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.337862 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.338185 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.338320 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.338459 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.338599 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.338733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.338865 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.339004 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.339144 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.339144 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.339397 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.339527 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.339527 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.339796 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.339929 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.339929 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.340179 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.340309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.340309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.340577 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.340707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.340707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.340969 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.341108 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.341256 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.341393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.341393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.341639 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.341793 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.341793 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.342067 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.342206 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.342206 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.342451 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.342580 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.342580 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.342853 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.343016 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.343150 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.343280 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.343410 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.343548 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.343548 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.343804 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.343934 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.343934 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.344179 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.344318 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.344449 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.344586 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.344586 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.344831 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.344968 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.344968 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.345225 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.345362 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.345362 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.346253 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.346469 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.346616 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.346755 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.346755 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.347342 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.347555 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.347555 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.347819 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.347958 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.348270 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.348406 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.348546 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.348687 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.348687 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.348946 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.349084 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.349084 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.349331 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.349470 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.349470 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.349717 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.349865 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.349865 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.349865 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.350308 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.350443 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.350574 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.350711 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.350711 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.350966 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.351104 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.351235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.351380 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.351380 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.351644 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.351789 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.351929 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.352059 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.352059 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.352304 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.352441 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.352441 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.352710 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.352849 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.352996 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.353127 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.353127 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.353392 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.353524 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.353654 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.353844 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.353844 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.354104 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.354234 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.354372 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.354502 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.354502 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.354753 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.354892 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.354892 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.355146 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.355276 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.355405 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.355534 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.355534 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.355798 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.355937 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.355937 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.356247 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.356386 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.356610 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.356754 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.356754 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.357336 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.357482 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.357482 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.357864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.357996 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.358126 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.358431 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.358431 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.358747 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.358882 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.359021 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.359153 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.359153 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.359415 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.359552 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.359691 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.359831 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.359831 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.360087 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.360217 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.360346 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.360518 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.360518 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.360784 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.360915 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.360915 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.361184 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.361318 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.361318 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.361586 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.361724 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.361930 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.362063 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.362063 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.362310 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.362455 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.362455 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.362702 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.362832 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.362832 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.363098 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.363230 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.363230 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.364084 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.364231 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.364364 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.364502 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.364502 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.364763 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.364894 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.364894 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.365208 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.365323 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.365460 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.365608 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.365608 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.366134 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.366275 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.366406 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.366544 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.366787 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.366932 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.366932 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.367561 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.367720 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.367929 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.368073 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.368073 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.368323 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.368655 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.368655 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.368926 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.369066 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.369198 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.369337 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.369337 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.369628 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.369789 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.369789 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.370047 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.370177 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.370307 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.370445 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.370445 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.370712 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.370851 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.370851 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.371103 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.371240 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.371240 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.371510 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.371648 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.371778 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.371914 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.371914 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.372180 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.372309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.372309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.372569 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.372707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.372707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.372965 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.373094 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.373231 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.373360 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.373360 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.373613 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.373766 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.373766 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.374132 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.374269 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.374400 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.374546 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.374724 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.374872 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.374872 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.375120 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.375259 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.375390 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.375520 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.375520 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.375775 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.375905 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.376129 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.376262 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.376262 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.376538 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.376694 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.376967 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.377137 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.377137 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.377794 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.377978 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.378126 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.378282 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.378282 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.378597 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.378943 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.378943 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.379227 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.379385 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.379385 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.379677 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.379830 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.379974 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.380117 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.380270 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.380421 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.380421 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.380715 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.380860 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.380860 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.381144 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.381287 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.381287 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.381568 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.381719 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.381951 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.382106 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.382106 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.382408 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.382552 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.382552 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.382847 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.382991 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.383141 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.383291 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.383442 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.383592 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.383592 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.383897 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.384041 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.384200 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.384357 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.384357 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.384638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.384780 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.384929 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.385081 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.385081 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.385362 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.385505 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.385505 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.385854 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.386020 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.386184 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.386329 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.386329 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.386609 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.386752 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.386752 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.387135 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.387296 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.387441 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.387616 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.387795 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.387954 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.387954 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.388247 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.388392 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.388392 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.388663 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.388840 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.388840 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.389291 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.389444 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.389444 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.389740 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.389910 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.389910 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.390193 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.390193 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.390465 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.390629 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.390814 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.390971 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.391123 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.391123 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.391396 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.391547 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.391547 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.391819 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.391961 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.392116 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.392116 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.392915 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.393077 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.393222 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.393222 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.393494 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.393646 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.393861 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.394013 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.394156 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.394299 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.394450 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.394612 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.394757 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.394899 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.395051 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.395195 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.395344 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.395498 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.395650 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.395793 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.395936 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.396085 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.396236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.396397 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.396566 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.396723 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.396874 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.397024 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.397265 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.397424 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.397577 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.397720 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.397890 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.398034 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.398251 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.398397 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.398551 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.398703 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.398855 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.399017 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.399345 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.399499 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.399650 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.399796 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.399947 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.400092 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.400245 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.400397 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.400548 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.400702 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.400846 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.401001 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.401145 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.401288 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.401439 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.401582 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.401725 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.401907 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.401907 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.402189 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.402332 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.402482 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.402636 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.402788 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.402932 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.403075 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.403232 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.403649 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.403803 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.403962 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.404127 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.404458 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.404609 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.404752 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.404921 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.405074 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.405225 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.405368 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.405519 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.405519 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.405835 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.405997 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.406142 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.406142 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.406431 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.406431 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.406718 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.406718 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.407016 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.407161 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.407400 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.407553 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.407708 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.407860 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.407860 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.408695 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.408853 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.409013 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.409158 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.409502 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.409667 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.409844 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.409992 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.410154 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.410307 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.410452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.410452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.410733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.410878 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.411030 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.411175 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.411319 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.411483 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.411636 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.411788 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.411945 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.412096 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.412241 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.412392 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.412535 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.412687 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.412687 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.412969 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.412969 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.413252 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.413407 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.413565 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.413565 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.413887 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.413996 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.414088 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.414175 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.414277 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.414366 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.414457 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.414548 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.414633 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.414716 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.414809 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.414893 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.414984 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.415075 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.415159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.415252 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.415344 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.415429 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.415523 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.415607 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.415697 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.415790 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.415882 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.415965 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.416109 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.416209 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.416302 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.416394 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.416480 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.416571 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.416656 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.416746 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.416838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.416923 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.417006 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.417088 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.417171 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.417253 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.417350 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.417437 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.417517 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.417601 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.417683 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.417827 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.417925 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.418038 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.418120 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.418223 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.418311 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.418408 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.418494 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.418586 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.418677 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.418784 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.418877 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.418974 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.419066 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.419151 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.419242 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.419327 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.419416 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.419558 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.419632 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.419723 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.419808 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.419890 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.419981 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.420071 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.420159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.420248 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.420339 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.420423 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.420513 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.420598 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.420687 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.420777 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.420861 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.420950 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.421042 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.421133 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.421225 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.421315 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.421399 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.421482 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.421581 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.421674 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.421887 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.421979 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.422075 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.422170 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.422256 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.422338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.422427 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.422518 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.422605 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.422687 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.422766 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.422855 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.422939 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.423020 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.423102 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.423193 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.423193 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.423345 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.423435 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.423520 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.423610 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.423725 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.423817 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.423902 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.423985 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.424074 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.424178 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.424264 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.424347 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.424437 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.424521 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.424674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.424782 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.424869 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.424958 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.425048 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.425132 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.425215 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.425305 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.425390 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.425479 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.425576 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.425662 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.425777 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.425865 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.425959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426051 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426136 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426136 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426296 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426296 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426449 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426538 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 02:00:28.426624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.426624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.427236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.427236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.427236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.427236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.427236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.427236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.427236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.427236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.427897 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.427897 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.427897 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.428300 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.428482 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.428800 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.429123 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.429444 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.429780 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.430106 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.430425 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.430743 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.431062 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.431398 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.431726 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.432058 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.432401 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.432724 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.433047 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.433370 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.433693 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.434082 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.434409 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.435083 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.435307 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.435633 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.435959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.436278 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.436597 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.436918 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.437238 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.437557 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.437899 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.438221 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.438545 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.438876 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.439579 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.439701 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.440152 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.440470 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.440631 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.441786 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.441786 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.442139 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.442473 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.442806 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.443131 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.443458 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.443807 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.444112 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.444275 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_db.sqlalchemy.engines [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:00:28.444435 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.444731 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.445092 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.445407 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.445738 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.446082 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.446396 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.446725 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.447039 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.447590 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.447955 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.448280 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.448615 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.448947 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.449272 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.449638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.450020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.450337 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.450651 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.450973 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.451292 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.451604 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.451916 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.452237 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.452554 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.452868 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.453186 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.453499 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.453857 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.454175 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.454489 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.454801 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.455655 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.455968 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.456280 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.456595 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.456907 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.457226 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.457537 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.457877 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.458189 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.458510 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.458817 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.459134 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.459446 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.459775 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.460084 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.460463 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.460789 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.461108 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.461440 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.461865 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.462174 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.462532 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.462856 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.463404 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.463746 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.464091 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.464518 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.464868 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.465184 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.465503 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.465849 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.466181 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.466498 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.466817 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.467132 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.467447 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.467763 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.468078 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.468408 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.468713 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.469027 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.469348 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.469695 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.470047 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.470370 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.471316 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.471642 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.471963 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.472282 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.472597 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.472913 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.473235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.473571 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.473925 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.474229 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.474660 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.474982 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.475309 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.475642 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.475961 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.476294 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.476623 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.476942 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.477272 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.477590 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.477959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.478305 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.478647 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.478982 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.479298 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.479608 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.479918 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.480235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.480575 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.480898 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.481227 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.481546 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.481900 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.482217 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.482544 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.482871 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.483192 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.483508 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.483846 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.484211 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.484481 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.484799 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.485117 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.485438 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.485764 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.486109 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.486466 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.486781 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.487113 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.487435 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.487762 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.488084 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.488405 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.488808 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.489158 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.489365 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.489680 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.490020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.490343 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.490666 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.490998 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.491329 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.491661 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.491990 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.492343 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.492663 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.493016 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.493351 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:00:28.493598 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 02:00:28.515267 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_db.sqlalchemy.engines [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:00:28.524772 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.context [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7348e7ae-6880-4f81-9ff6-b2f30a471bee(cell1) {{(pid=115760) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 02:00:28.529195 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:28.530837 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:28.531666 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:28.534259 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:28.544996 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_db.sqlalchemy.engines [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:00:28.545910 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_db.sqlalchemy.engines [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:00:28.594668 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.context [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7348e7ae-6880-4f81-9ff6-b2f30a471bee(cell1) {{(pid=115761) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 02:00:28.599053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:28.600653 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:28.601474 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:28.603426 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:28.614159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_db.sqlalchemy.engines [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:00:28.615037 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_db.sqlalchemy.engines [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:00:28.839009 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_db.sqlalchemy.engines [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:00:28.880431 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_db.sqlalchemy.engines [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:00:29.161397 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: WARNING keystonemiddleware.auth_token [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 02:00:29.168014 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: WARNING keystonemiddleware.auth_token [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 02:00:29.205911 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: WARNING keystonemiddleware.auth_token [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 02:00:29.212539 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: WARNING keystonemiddleware.auth_token [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 02:00:29.514702 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: WARNING keystonemiddleware.auth_token [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 02:00:29.520037 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: WARNING keystonemiddleware.auth_token [None req-6f0c39a0-b82c-40be-bcea-adc4dfc3a5eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 02:00:29.525179 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55752d5959c0 pid: 115760 (default app) Jan 28 02:00:29.559062 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: WARNING keystonemiddleware.auth_token [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 02:00:29.564678 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: WARNING keystonemiddleware.auth_token [None req-c998a169-c9c7-4d6d-95a0-7236b01aa210 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 02:00:29.569894 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55752d5959c0 pid: 115761 (default app) Jan 28 02:01:16.211137 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1220400304", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "networks": [{"uuid": "a12a014d-4a71-408b-a943-054c73574ed9"}]}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:16.874868 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.network.neutron [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] validate_networks() for [('a12a014d-4a71-408b-a943-054c73574ed9', None, None, None, None, None)] {{(pid=115760) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:01:18.759540 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Flavor limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:01:18.761591 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Image limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:01:18.762340 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Flavor pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:01:18.763974 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Image pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:01:18.764619 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:01:18.807701 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:18.811634 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:18.815343 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:18.815788 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:18.921529 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Getting quotas for project 6639261ee8ee46e0a4e3a01eb63b9ab4. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:01:18.938347 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Getting quotas for user 9717e2ab2be74631aba4b196112bf984 and project 6639261ee8ee46e0a4e3a01eb63b9ab4. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:01:18.993393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Going to run 1 instances... {{(pid=115760) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:01:19.000621 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:01:19.091293 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1168118558", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "networks": [{"uuid": "27b7e674-c1b4-46df-b078-0f6e5b07b279"}]}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:19.259520 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-eebf427b-f267-4b24-a7af-cfe3979a07d1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.067647 Jan 28 02:01:19.260158 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 1/1] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:01:19.278471 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6425dc4b-e33b-4e40-8d88-9baedcad2400 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:19.281353 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6425dc4b-e33b-4e40-8d88-9baedcad2400 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:19.602084 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6425dc4b-e33b-4e40-8d88-9baedcad2400 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:19.629997 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6425dc4b-e33b-4e40-8d88-9baedcad2400 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1218 microversion: 2.1 time: 0.355546 Jan 28 02:01:19.643338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 2/2] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:19 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1218 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:19.984657 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.network.neutron [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] validate_networks() for [('27b7e674-c1b4-46df-b078-0f6e5b07b279', None, None, None, None, None)] {{(pid=115761) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:01:20.649979 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7bc5a38e-72c6-4c88-a6bf-5ebcc6ebc632 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:20.651312 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7bc5a38e-72c6-4c88-a6bf-5ebcc6ebc632 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:21.051291 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7bc5a38e-72c6-4c88-a6bf-5ebcc6ebc632 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:21.065912 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7bc5a38e-72c6-4c88-a6bf-5ebcc6ebc632 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1218 microversion: 2.1 time: 0.420212 Jan 28 02:01:21.066830 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 3/3] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:20 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1218 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:21.702130 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Flavor limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:01:21.702675 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Image limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:01:21.703020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Flavor pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:01:21.703427 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Image pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:01:21.704372 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:01:21.728044 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:21.728641 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:21.729281 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:21.729715 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:21.800006 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Getting quotas for project e903984909674521a44fe37d95d94b8c. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:01:21.815970 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Getting quotas for user 3bf94c1b148942939821bdd801d4f907 and project e903984909674521a44fe37d95d94b8c. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:01:21.839337 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Going to run 1 instances... {{(pid=115761) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:01:21.842259 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:01:21.971845 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b69ffa0a-7504-4823-835e-2ca619066e7f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.634111 Jan 28 02:01:21.977998 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 1/4] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:01:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:01:21.983826 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-99ba277c-eb02-435b-9061-7622717ed50b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:21.986368 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-99ba277c-eb02-435b-9061-7622717ed50b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:22.083857 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ff6b2cdf-4771-4c34-9310-c95d7ee6d10a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:22.084502 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ff6b2cdf-4771-4c34-9310-c95d7ee6d10a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:22.113983 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff6b2cdf-4771-4c34-9310-c95d7ee6d10a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:22.114737 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff6b2cdf-4771-4c34-9310-c95d7ee6d10a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:22.115798 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff6b2cdf-4771-4c34-9310-c95d7ee6d10a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:22.118674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff6b2cdf-4771-4c34-9310-c95d7ee6d10a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:22.296060 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-99ba277c-eb02-435b-9061-7622717ed50b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:22.311680 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-99ba277c-eb02-435b-9061-7622717ed50b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1215 microversion: 2.1 time: 0.325622 Jan 28 02:01:22.312732 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 4/5] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:21 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1215 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:22.395479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ff6b2cdf-4771-4c34-9310-c95d7ee6d10a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:22.416644 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ff6b2cdf-4771-4c34-9310-c95d7ee6d10a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1222 microversion: 2.1 time: 0.336731 Jan 28 02:01:22.417437 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 2/6] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:22 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1222 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:23.333053 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-87b54bc9-d463-4dc8-bac6-33fa495fc1a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:23.333691 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-87b54bc9-d463-4dc8-bac6-33fa495fc1a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:23.352400 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-87b54bc9-d463-4dc8-bac6-33fa495fc1a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:23.353303 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-87b54bc9-d463-4dc8-bac6-33fa495fc1a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:23.354476 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-87b54bc9-d463-4dc8-bac6-33fa495fc1a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:23.355246 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-87b54bc9-d463-4dc8-bac6-33fa495fc1a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:23.434784 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-91a37c2a-4724-400f-86e7-3f5fabd913db tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:23.436452 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-91a37c2a-4724-400f-86e7-3f5fabd913db tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:23.449090 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-91a37c2a-4724-400f-86e7-3f5fabd913db tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:23.453353 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-91a37c2a-4724-400f-86e7-3f5fabd913db tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:23.455023 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-91a37c2a-4724-400f-86e7-3f5fabd913db tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:23.457681 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-91a37c2a-4724-400f-86e7-3f5fabd913db tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:23.670269 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-87b54bc9-d463-4dc8-bac6-33fa495fc1a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:23.692794 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-91a37c2a-4724-400f-86e7-3f5fabd913db tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:23.695413 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-87b54bc9-d463-4dc8-bac6-33fa495fc1a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1219 microversion: 2.1 time: 0.369290 Jan 28 02:01:23.696543 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 5/7] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:23 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1219 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:23.710885 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-91a37c2a-4724-400f-86e7-3f5fabd913db tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1270 microversion: 2.1 time: 0.280308 Jan 28 02:01:23.712629 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 3/8] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:23 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1270 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:24.712378 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9a276bb9-16c9-44a1-98d4-b2f372dc1d5e tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:24.713161 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9a276bb9-16c9-44a1-98d4-b2f372dc1d5e tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:24.722599 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9a276bb9-16c9-44a1-98d4-b2f372dc1d5e tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:24.723485 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9a276bb9-16c9-44a1-98d4-b2f372dc1d5e tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:24.725179 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9a276bb9-16c9-44a1-98d4-b2f372dc1d5e tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:24.733645 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2adf7fb4-b64b-4c09-8bf1-0af7f1d9cbf7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:24.735002 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-2adf7fb4-b64b-4c09-8bf1-0af7f1d9cbf7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:24.739074 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9a276bb9-16c9-44a1-98d4-b2f372dc1d5e tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:24.750071 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2adf7fb4-b64b-4c09-8bf1-0af7f1d9cbf7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:24.750956 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2adf7fb4-b64b-4c09-8bf1-0af7f1d9cbf7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:24.757503 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2adf7fb4-b64b-4c09-8bf1-0af7f1d9cbf7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:24.758040 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2adf7fb4-b64b-4c09-8bf1-0af7f1d9cbf7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:25.477495 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-2adf7fb4-b64b-4c09-8bf1-0af7f1d9cbf7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:25.487437 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2adf7fb4-b64b-4c09-8bf1-0af7f1d9cbf7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1276 microversion: 2.1 time: 0.759288 Jan 28 02:01:25.488034 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 4/9] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:24 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1276 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:25.488403 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9a276bb9-16c9-44a1-98d4-b2f372dc1d5e tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:25.502106 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9a276bb9-16c9-44a1-98d4-b2f372dc1d5e tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1267 microversion: 2.1 time: 0.787441 Jan 28 02:01:25.503086 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 6/10] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:24 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1267 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:26.214076 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-198636553", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:26.321041 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.network.neutron [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] validate_networks() for [('69e9f2dd-172d-4c3f-b2f8-7e4aa9886d2f', None, None, None, None, None)] {{(pid=115761) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:01:26.506795 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b8bc75cd-d4eb-4da0-98e3-9f312dc70153 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:26.507622 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b8bc75cd-d4eb-4da0-98e3-9f312dc70153 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:26.525487 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b8bc75cd-d4eb-4da0-98e3-9f312dc70153 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:26.529255 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b8bc75cd-d4eb-4da0-98e3-9f312dc70153 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:26.535757 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b8bc75cd-d4eb-4da0-98e3-9f312dc70153 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:26.536833 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b8bc75cd-d4eb-4da0-98e3-9f312dc70153 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:26.815000 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b8bc75cd-d4eb-4da0-98e3-9f312dc70153 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:26.829600 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b8bc75cd-d4eb-4da0-98e3-9f312dc70153 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1276 microversion: 2.1 time: 0.326554 Jan 28 02:01:26.831755 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 7/11] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:26 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1276 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:26.844298 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6510a0d3-98d6-4b6d-b70c-80917af73a83 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:26.848426 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6510a0d3-98d6-4b6d-b70c-80917af73a83 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:26.872457 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6510a0d3-98d6-4b6d-b70c-80917af73a83 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:26.872959 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6510a0d3-98d6-4b6d-b70c-80917af73a83 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:26.877816 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6510a0d3-98d6-4b6d-b70c-80917af73a83 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:26.878738 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6510a0d3-98d6-4b6d-b70c-80917af73a83 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:27.073248 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6510a0d3-98d6-4b6d-b70c-80917af73a83 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:27.089941 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6510a0d3-98d6-4b6d-b70c-80917af73a83 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1273 microversion: 2.1 time: 0.253093 Jan 28 02:01:27.092081 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 8/12] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:26 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:27.849361 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c99a0539-7441-4bc7-8f8f-9be5d0d60d3f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:27.850061 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c99a0539-7441-4bc7-8f8f-9be5d0d60d3f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:27.857473 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c99a0539-7441-4bc7-8f8f-9be5d0d60d3f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:27.857964 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c99a0539-7441-4bc7-8f8f-9be5d0d60d3f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:27.858756 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c99a0539-7441-4bc7-8f8f-9be5d0d60d3f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:27.859192 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c99a0539-7441-4bc7-8f8f-9be5d0d60d3f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:28.013324 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c99a0539-7441-4bc7-8f8f-9be5d0d60d3f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:28.025708 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c99a0539-7441-4bc7-8f8f-9be5d0d60d3f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1276 microversion: 2.1 time: 0.180697 Jan 28 02:01:28.037398 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 9/13] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:27 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:28.110573 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-db88b924-2bb5-442e-aa50-3dc61f65a505 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:28.111895 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-db88b924-2bb5-442e-aa50-3dc61f65a505 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:28.123485 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-db88b924-2bb5-442e-aa50-3dc61f65a505 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:28.124215 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-db88b924-2bb5-442e-aa50-3dc61f65a505 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:28.128560 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-db88b924-2bb5-442e-aa50-3dc61f65a505 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:28.129931 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-db88b924-2bb5-442e-aa50-3dc61f65a505 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:28.378221 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-db88b924-2bb5-442e-aa50-3dc61f65a505 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:28.404533 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-db88b924-2bb5-442e-aa50-3dc61f65a505 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1273 microversion: 2.1 time: 0.296183 Jan 28 02:01:28.418759 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 10/14] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:28 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:28.795462 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Flavor limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:01:28.796055 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Image limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:01:28.796852 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Flavor pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:01:28.798067 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Image pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:01:28.798659 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:01:28.823953 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:28.831021 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:28.831996 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:28.832473 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:28.933087 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Getting quotas for project a830c3a19c3740619ece0b4ca820490e. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:01:28.949739 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Getting quotas for user a7dc50f676f942319f779d8f141502f4 and project a830c3a19c3740619ece0b4ca820490e. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:01:29.012590 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Going to run 1 instances... {{(pid=115761) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:01:29.021122 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:01:29.042978 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a5022d76-92fa-47aa-ad15-c8d68272451c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:29.043786 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a5022d76-92fa-47aa-ad15-c8d68272451c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:29.052194 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a5022d76-92fa-47aa-ad15-c8d68272451c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:29.052647 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a5022d76-92fa-47aa-ad15-c8d68272451c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:29.053442 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a5022d76-92fa-47aa-ad15-c8d68272451c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:29.058936 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a5022d76-92fa-47aa-ad15-c8d68272451c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:29.146983 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-fba62114-4a14-4472-bbdc-dc529aa2a169 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.642827 Jan 28 02:01:29.162541 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 5/15] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:01:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 3674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:01:29.186408 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-89bb5494-2a26-4fbd-8889-789f787d207f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:29.187414 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-89bb5494-2a26-4fbd-8889-789f787d207f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:30.034455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-89bb5494-2a26-4fbd-8889-789f787d207f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:30.091713 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-89bb5494-2a26-4fbd-8889-789f787d207f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1221 microversion: 2.1 time: 0.922572 Jan 28 02:01:30.093702 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 6/16] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:29 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1221 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:30.115363 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a8555435-19f7-4b04-a04b-6c121ad160db tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:30.116462 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a8555435-19f7-4b04-a04b-6c121ad160db tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:30.124311 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a8555435-19f7-4b04-a04b-6c121ad160db tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:30.125006 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a8555435-19f7-4b04-a04b-6c121ad160db tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:30.126825 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a8555435-19f7-4b04-a04b-6c121ad160db tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:30.127455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a8555435-19f7-4b04-a04b-6c121ad160db tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:30.318387 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a8555435-19f7-4b04-a04b-6c121ad160db tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:30.325680 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a8555435-19f7-4b04-a04b-6c121ad160db tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1273 microversion: 2.1 time: 0.218498 Jan 28 02:01:30.326277 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 7/17] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:30 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:30.337466 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-446287195", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:30.441166 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.network.neutron [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] validate_networks() for [('69e9f2dd-172d-4c3f-b2f8-7e4aa9886d2f', None, None, None, None, None)] {{(pid=115761) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:01:30.475225 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a5022d76-92fa-47aa-ad15-c8d68272451c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:30.489630 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a5022d76-92fa-47aa-ad15-c8d68272451c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 1.450252 Jan 28 02:01:30.495533 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 11/18] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:29 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:31.561554 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a5030849-0a81-47b1-b6db-62f877018ec7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'create', calling method: .version_select at 0x7f08d869c700>, body: {"keypair": {"name": "tempest-keypair-656139416"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:31.654579 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-a5030849-0a81-47b1-b6db-62f877018ec7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Getting quotas for project 578fc5bd64da4dcdbff2e317361168ec. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:01:31.668668 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-a5030849-0a81-47b1-b6db-62f877018ec7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Getting quotas for user 264a23388dc64b269325ae52eb4130de and project 578fc5bd64da4dcdbff2e317361168ec. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:01:31.928890 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-a5030849-0a81-47b1-b6db-62f877018ec7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Getting quotas for project 578fc5bd64da4dcdbff2e317361168ec. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:01:31.944161 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-a5030849-0a81-47b1-b6db-62f877018ec7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Getting quotas for user 264a23388dc64b269325ae52eb4130de and project 578fc5bd64da4dcdbff2e317361168ec. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:01:31.966727 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Flavor limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:01:31.968169 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Image limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:01:31.970072 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Flavor pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:01:31.974635 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Image pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:01:31.975229 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:01:31.982021 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a5030849-0a81-47b1-b6db-62f877018ec7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.729558 Jan 28 02:01:31.982935 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 12/19] 10.222.0.77 () {62 vars in 1198 bytes} [Fri Jan 28 02:01:31 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 731 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 28 02:01:31.989973 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2659195b-84bd-47cc-b112-5829ef08cef2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:31.993700 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2659195b-84bd-47cc-b112-5829ef08cef2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:32.004029 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2659195b-84bd-47cc-b112-5829ef08cef2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.007189 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.007855 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2659195b-84bd-47cc-b112-5829ef08cef2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.008878 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.009099 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2659195b-84bd-47cc-b112-5829ef08cef2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.009551 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2659195b-84bd-47cc-b112-5829ef08cef2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.013914 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.014584 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.057542 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Getting quotas for project a830c3a19c3740619ece0b4ca820490e. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:01:32.063302 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Getting quotas for user a7dc50f676f942319f779d8f141502f4 and project a830c3a19c3740619ece0b4ca820490e. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:01:32.103900 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Going to run 1 instances... {{(pid=115761) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:01:32.108092 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:01:32.207284 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b3ca7053-75cc-4e49-aa1e-1948fb8f774e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.877926 Jan 28 02:01:32.208910 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 8/20] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:01:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:01:32.223981 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b0378fac-111a-490e-bf27-d1454e72af78 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:32.224856 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b0378fac-111a-490e-bf27-d1454e72af78 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:32.235031 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b0378fac-111a-490e-bf27-d1454e72af78 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.235724 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b0378fac-111a-490e-bf27-d1454e72af78 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.236699 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b0378fac-111a-490e-bf27-d1454e72af78 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.237348 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b0378fac-111a-490e-bf27-d1454e72af78 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.653986 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-2659195b-84bd-47cc-b112-5829ef08cef2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:32.664979 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2659195b-84bd-47cc-b112-5829ef08cef2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.680444 Jan 28 02:01:32.681826 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 13/21] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:31 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:32.689501 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-674bd96e-1e7b-4b8e-b44e-12e261bc4470 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:32.691510 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-674bd96e-1e7b-4b8e-b44e-12e261bc4470 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:32.712515 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b0378fac-111a-490e-bf27-d1454e72af78 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:32.720136 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b0378fac-111a-490e-bf27-d1454e72af78 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.508978 Jan 28 02:01:32.724283 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 9/22] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:32 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:32.770326 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-674bd96e-1e7b-4b8e-b44e-12e261bc4470 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:32.779319 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-674bd96e-1e7b-4b8e-b44e-12e261bc4470 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1221 microversion: 2.1 time: 0.095844 Jan 28 02:01:32.780507 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 14/23] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:32 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:32.836442 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-2d774baf-fc57-4909-b163-3d576d8372da req-1e845b19-7014-4f3e-9317-d9c67bb5ab5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c7e70ce-ff2e-4323-baec-1455763bb95f", "tag": "bdfdebab-1bce-49af-b683-2bf00d7f807c"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:32.839044 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:32.839044 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:01:32.850931 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-2d774baf-fc57-4909-b163-3d576d8372da req-1e845b19-7014-4f3e-9317-d9c67bb5ab5c service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.851529 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-2d774baf-fc57-4909-b163-3d576d8372da req-1e845b19-7014-4f3e-9317-d9c67bb5ab5c service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.879821 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-2d774baf-fc57-4909-b163-3d576d8372da req-1e845b19-7014-4f3e-9317-d9c67bb5ab5c service nova] Creating event network-changed:bdfdebab-1bce-49af-b683-2bf00d7f807c for instance 0c7e70ce-ff2e-4323-baec-1455763bb95f on hv-cinder-82497 Jan 28 02:01:32.880440 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-2d774baf-fc57-4909-b163-3d576d8372da req-1e845b19-7014-4f3e-9317-d9c67bb5ab5c service nova] Acquired lock "compute-rpcapi-router" {{(pid=115761) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 28 02:01:32.881923 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7fb61ac-828e-4e41-a2a6-756ae964e9a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.882540 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7fb61ac-828e-4e41-a2a6-756ae964e9a6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.883515 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7fb61ac-828e-4e41-a2a6-756ae964e9a6 None None] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.883944 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7fb61ac-828e-4e41-a2a6-756ae964e9a6 None None] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.896199 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.compute.rpcapi [None req-a7fb61ac-828e-4e41-a2a6-756ae964e9a6 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 02:01:32.897301 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7fb61ac-828e-4e41-a2a6-756ae964e9a6 None None] Releasing lock "compute-rpcapi-router" {{(pid=115761) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 28 02:01:32.927133 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a7fb61ac-828e-4e41-a2a6-756ae964e9a6 None None] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201408 Jan 28 02:01:32.928415 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 10/24] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:33.686253 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-29723c30-cead-4184-9dea-5ce7fb406558 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:33.689457 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-29723c30-cead-4184-9dea-5ce7fb406558 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:33.702615 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-29723c30-cead-4184-9dea-5ce7fb406558 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:33.706790 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-29723c30-cead-4184-9dea-5ce7fb406558 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:33.708023 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-29723c30-cead-4184-9dea-5ce7fb406558 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:33.712182 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-29723c30-cead-4184-9dea-5ce7fb406558 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:33.747400 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c8fe801b-fdab-4daf-9e28-b7d88932a34a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:33.750310 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c8fe801b-fdab-4daf-9e28-b7d88932a34a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:33.772670 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8fe801b-fdab-4daf-9e28-b7d88932a34a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:33.774611 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8fe801b-fdab-4daf-9e28-b7d88932a34a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:33.777849 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8fe801b-fdab-4daf-9e28-b7d88932a34a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:33.779437 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8fe801b-fdab-4daf-9e28-b7d88932a34a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:34.453113 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-29723c30-cead-4184-9dea-5ce7fb406558 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:34.468206 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-29723c30-cead-4184-9dea-5ce7fb406558 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.785189 Jan 28 02:01:34.470397 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 15/25] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:33 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:34.498505 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4e26b8ee-f127-4ddc-bfb1-30afd1024211 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:34.499907 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4e26b8ee-f127-4ddc-bfb1-30afd1024211 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:34.515209 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4e26b8ee-f127-4ddc-bfb1-30afd1024211 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:34.516827 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4e26b8ee-f127-4ddc-bfb1-30afd1024211 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:34.518249 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4e26b8ee-f127-4ddc-bfb1-30afd1024211 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:34.520880 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4e26b8ee-f127-4ddc-bfb1-30afd1024211 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:34.565851 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c8fe801b-fdab-4daf-9e28-b7d88932a34a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:34.574640 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c8fe801b-fdab-4daf-9e28-b7d88932a34a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.837847 Jan 28 02:01:34.578982 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 11/26] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:33 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:34.722003 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4e26b8ee-f127-4ddc-bfb1-30afd1024211 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:34.731794 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4e26b8ee-f127-4ddc-bfb1-30afd1024211 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1225 microversion: 2.1 time: 0.244814 Jan 28 02:01:34.736183 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 16/27] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:34 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1225 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:35.487427 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4e89d145-8fb3-45bd-92d2-58aef33eb3a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:35.488968 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4e89d145-8fb3-45bd-92d2-58aef33eb3a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:35.506776 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4e89d145-8fb3-45bd-92d2-58aef33eb3a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:35.511369 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4e89d145-8fb3-45bd-92d2-58aef33eb3a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:35.512638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4e89d145-8fb3-45bd-92d2-58aef33eb3a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:35.513837 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4e89d145-8fb3-45bd-92d2-58aef33eb3a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:35.595690 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f867cddd-eb07-4b18-9331-665fc56fa63b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:35.597533 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f867cddd-eb07-4b18-9331-665fc56fa63b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:35.606583 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f867cddd-eb07-4b18-9331-665fc56fa63b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:35.608537 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f867cddd-eb07-4b18-9331-665fc56fa63b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:35.610404 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f867cddd-eb07-4b18-9331-665fc56fa63b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:35.611602 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f867cddd-eb07-4b18-9331-665fc56fa63b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:36.662023 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4e89d145-8fb3-45bd-92d2-58aef33eb3a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:36.674621 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4e89d145-8fb3-45bd-92d2-58aef33eb3a3 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 1.189854 Jan 28 02:01:36.690407 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 12/28] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:35 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:36.700214 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-82940756-7430-4153-aa45-4a55c08e28ed tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:36.701948 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-82940756-7430-4153-aa45-4a55c08e28ed tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:36.707398 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-f867cddd-eb07-4b18-9331-665fc56fa63b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:36.716746 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f867cddd-eb07-4b18-9331-665fc56fa63b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 1.125424 Jan 28 02:01:36.735233 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 17/29] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:35 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:36.744073 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-82940756-7430-4153-aa45-4a55c08e28ed tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:36.745297 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-82940756-7430-4153-aa45-4a55c08e28ed tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:36.747581 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-82940756-7430-4153-aa45-4a55c08e28ed tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:36.749375 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-82940756-7430-4153-aa45-4a55c08e28ed tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:36.937830 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-82940756-7430-4153-aa45-4a55c08e28ed tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:36.949231 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-82940756-7430-4153-aa45-4a55c08e28ed tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1279 microversion: 2.1 time: 0.255986 Jan 28 02:01:36.950867 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 13/30] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:36 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1279 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:37.197686 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-601022982", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34615009-fca5-44cc-84b3-0752c6a7e426"}], "security_groups": [{"name": "tempest-securitygroup--181446349"}], "key_name": "tempest-keypair-656139416", "user_data": "}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:37.414323 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.network.neutron [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] validate_networks() for [('34615009-fca5-44cc-84b3-0752c6a7e426', None, None, None, None, None)] {{(pid=115760) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:01:37.700196 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-34a36d4b-39bd-4e98-a7dc-761ca9922ffe tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:37.710103 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-34a36d4b-39bd-4e98-a7dc-761ca9922ffe tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:37.718601 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-34a36d4b-39bd-4e98-a7dc-761ca9922ffe tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:37.719923 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-34a36d4b-39bd-4e98-a7dc-761ca9922ffe tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:37.721574 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-34a36d4b-39bd-4e98-a7dc-761ca9922ffe tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:37.722303 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-34a36d4b-39bd-4e98-a7dc-761ca9922ffe tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.211581 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-34a36d4b-39bd-4e98-a7dc-761ca9922ffe tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:38.223849 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-34a36d4b-39bd-4e98-a7dc-761ca9922ffe tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.530348 Jan 28 02:01:38.224781 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 14/31] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:37 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:38.233875 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-baa78cfc-aadb-43d0-9ea4-e062db19c740 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:38.239526 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-baa78cfc-aadb-43d0-9ea4-e062db19c740 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:38.247130 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-baa78cfc-aadb-43d0-9ea4-e062db19c740 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.247862 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-baa78cfc-aadb-43d0-9ea4-e062db19c740 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.256924 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-baa78cfc-aadb-43d0-9ea4-e062db19c740 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.257827 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-baa78cfc-aadb-43d0-9ea4-e062db19c740 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.442913 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Flavor limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:01:38.443430 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Image limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:01:38.443797 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Flavor pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:01:38.444203 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Image pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:01:38.444614 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:01:38.461620 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.462106 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.463118 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.463557 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.474500 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-baa78cfc-aadb-43d0-9ea4-e062db19c740 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:38.485921 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Getting quotas for project 578fc5bd64da4dcdbff2e317361168ec. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:01:38.488020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-baa78cfc-aadb-43d0-9ea4-e062db19c740 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.261959 Jan 28 02:01:38.489031 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 15/32] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:38 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:38.498411 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Getting quotas for user 264a23388dc64b269325ae52eb4130de and project 578fc5bd64da4dcdbff2e317361168ec. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:01:38.501609 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-305c92af-b09c-4ee8-afc0-2d88511be457 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:38.502198 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-305c92af-b09c-4ee8-afc0-2d88511be457 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:38.508479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-305c92af-b09c-4ee8-afc0-2d88511be457 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.509709 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-305c92af-b09c-4ee8-afc0-2d88511be457 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.511696 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-305c92af-b09c-4ee8-afc0-2d88511be457 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.512290 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-305c92af-b09c-4ee8-afc0-2d88511be457 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.512525 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Going to run 1 instances... {{(pid=115760) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:01:38.515013 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:01:38.583203 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8e647025-4177-4dc4-af96-a20e2de7dfcd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.393414 Jan 28 02:01:38.584418 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 18/33] 10.222.0.77 () {62 vars in 1187 bytes} [Fri Jan 28 02:01:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 02:01:38.603998 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-305c92af-b09c-4ee8-afc0-2d88511be457 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:38.613120 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-305c92af-b09c-4ee8-afc0-2d88511be457 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1279 microversion: 2.1 time: 0.122814 Jan 28 02:01:38.613701 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 16/34] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:38 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1279 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:38.631401 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4e6746cd-a1a8-4d5a-b5e9-a86e869781fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:38.632019 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4e6746cd-a1a8-4d5a-b5e9-a86e869781fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:38.731690 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4e6746cd-a1a8-4d5a-b5e9-a86e869781fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:38.744639 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4e6746cd-a1a8-4d5a-b5e9-a86e869781fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:38.746191 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4e6746cd-a1a8-4d5a-b5e9-a86e869781fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:38.747293 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4e6746cd-a1a8-4d5a-b5e9-a86e869781fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1280 microversion: 2.20 time: 0.123961 Jan 28 02:01:38.747838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 17/35] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:38 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1280 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:38.786624 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-9f29ef8d-37b8-423d-9be9-a5a79f68142e req-eeddf568-f9c1-440e-93cd-9e93b585ead9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf2b320-c2a2-40d6-afca-73668bda7933", "tag": "8221b17d-3386-4e97-a157-ca4c9071392b"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:38.788996 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:38.788996 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:01:38.803354 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-9f29ef8d-37b8-423d-9be9-a5a79f68142e req-eeddf568-f9c1-440e-93cd-9e93b585ead9 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.803354 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-9f29ef8d-37b8-423d-9be9-a5a79f68142e req-eeddf568-f9c1-440e-93cd-9e93b585ead9 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.821371 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-9f29ef8d-37b8-423d-9be9-a5a79f68142e req-eeddf568-f9c1-440e-93cd-9e93b585ead9 service nova] Creating event network-changed:8221b17d-3386-4e97-a157-ca4c9071392b for instance aaf2b320-c2a2-40d6-afca-73668bda7933 on hv-cinder-82497 Jan 28 02:01:38.821913 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-9f29ef8d-37b8-423d-9be9-a5a79f68142e req-eeddf568-f9c1-440e-93cd-9e93b585ead9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115760) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 28 02:01:38.823039 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c639b3c4-aa3a-4dd8-b242-9b1262322dfa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.823495 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c639b3c4-aa3a-4dd8-b242-9b1262322dfa None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.824232 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c639b3c4-aa3a-4dd8-b242-9b1262322dfa None None] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.824655 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c639b3c4-aa3a-4dd8-b242-9b1262322dfa None None] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.832730 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.compute.rpcapi [None req-c639b3c4-aa3a-4dd8-b242-9b1262322dfa None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 02:01:38.833592 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c639b3c4-aa3a-4dd8-b242-9b1262322dfa None None] Releasing lock "compute-rpcapi-router" {{(pid=115760) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 28 02:01:38.856157 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c639b3c4-aa3a-4dd8-b242-9b1262322dfa None None] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270323 Jan 28 02:01:38.856769 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 19/36] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:39.240748 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-63ffa833-f135-4150-ad9d-85ed6eedb932 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:39.241364 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-63ffa833-f135-4150-ad9d-85ed6eedb932 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:39.247304 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-63ffa833-f135-4150-ad9d-85ed6eedb932 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:39.247762 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-63ffa833-f135-4150-ad9d-85ed6eedb932 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:39.248540 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-63ffa833-f135-4150-ad9d-85ed6eedb932 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:39.248972 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-63ffa833-f135-4150-ad9d-85ed6eedb932 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:39.378730 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-63ffa833-f135-4150-ad9d-85ed6eedb932 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:39.385968 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-63ffa833-f135-4150-ad9d-85ed6eedb932 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.148892 Jan 28 02:01:39.386678 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 18/37] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:39 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:39.505631 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-91106e7d-b072-482a-b64d-e42a92a08c0b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:39.506364 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-91106e7d-b072-482a-b64d-e42a92a08c0b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:39.512399 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-91106e7d-b072-482a-b64d-e42a92a08c0b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:39.512848 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-91106e7d-b072-482a-b64d-e42a92a08c0b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:39.513623 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-91106e7d-b072-482a-b64d-e42a92a08c0b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:39.514099 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-91106e7d-b072-482a-b64d-e42a92a08c0b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:39.629309 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-311549ee-beff-4c82-9e07-e203a3e0b91f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:39.630121 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-311549ee-beff-4c82-9e07-e203a3e0b91f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:39.635735 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-311549ee-beff-4c82-9e07-e203a3e0b91f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:39.636181 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-311549ee-beff-4c82-9e07-e203a3e0b91f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:39.636938 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-311549ee-beff-4c82-9e07-e203a3e0b91f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:39.637368 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-311549ee-beff-4c82-9e07-e203a3e0b91f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:39.644588 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-91106e7d-b072-482a-b64d-e42a92a08c0b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:39.651587 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-91106e7d-b072-482a-b64d-e42a92a08c0b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.150220 Jan 28 02:01:39.652158 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 20/38] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:39 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:39.756151 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-311549ee-beff-4c82-9e07-e203a3e0b91f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:39.763231 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-311549ee-beff-4c82-9e07-e203a3e0b91f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.137522 Jan 28 02:01:39.763782 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 19/39] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:39 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:39.766484 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4669aa9a-bb7a-4a84-9fcb-bc31e7cbb7e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:39.767089 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4669aa9a-bb7a-4a84-9fcb-bc31e7cbb7e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:39.772740 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4669aa9a-bb7a-4a84-9fcb-bc31e7cbb7e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:39.773205 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4669aa9a-bb7a-4a84-9fcb-bc31e7cbb7e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:39.773984 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4669aa9a-bb7a-4a84-9fcb-bc31e7cbb7e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:39.774420 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4669aa9a-bb7a-4a84-9fcb-bc31e7cbb7e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:39.996829 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4669aa9a-bb7a-4a84-9fcb-bc31e7cbb7e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:40.006659 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4669aa9a-bb7a-4a84-9fcb-bc31e7cbb7e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:40.008370 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4669aa9a-bb7a-4a84-9fcb-bc31e7cbb7e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:40.009801 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4669aa9a-bb7a-4a84-9fcb-bc31e7cbb7e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1284 microversion: 2.20 time: 0.247595 Jan 28 02:01:40.010339 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 21/40] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:39 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:01:40.402618 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-35539bff-ab30-40a5-bdc2-d7d3c22b6506 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:40.403242 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-35539bff-ab30-40a5-bdc2-d7d3c22b6506 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:40.413928 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-35539bff-ab30-40a5-bdc2-d7d3c22b6506 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:40.413928 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-35539bff-ab30-40a5-bdc2-d7d3c22b6506 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:40.413928 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-35539bff-ab30-40a5-bdc2-d7d3c22b6506 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:40.413928 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-35539bff-ab30-40a5-bdc2-d7d3c22b6506 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:40.543952 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-35539bff-ab30-40a5-bdc2-d7d3c22b6506 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:40.551765 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-35539bff-ab30-40a5-bdc2-d7d3c22b6506 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.152789 Jan 28 02:01:40.552320 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 20/41] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:40 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:40.668300 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-79d67cfb-3508-4ec6-b2b8-d22664256552 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:40.683777 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-79d67cfb-3508-4ec6-b2b8-d22664256552 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:40.683777 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-79d67cfb-3508-4ec6-b2b8-d22664256552 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:40.683777 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-79d67cfb-3508-4ec6-b2b8-d22664256552 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:40.683777 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-79d67cfb-3508-4ec6-b2b8-d22664256552 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:40.684320 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-79d67cfb-3508-4ec6-b2b8-d22664256552 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:40.780461 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0a9db9e2-8c6b-4f4e-b1fa-9ae151e1eb6d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:40.781276 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0a9db9e2-8c6b-4f4e-b1fa-9ae151e1eb6d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:40.790355 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0a9db9e2-8c6b-4f4e-b1fa-9ae151e1eb6d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:40.790920 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0a9db9e2-8c6b-4f4e-b1fa-9ae151e1eb6d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:40.791844 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0a9db9e2-8c6b-4f4e-b1fa-9ae151e1eb6d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:40.792287 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0a9db9e2-8c6b-4f4e-b1fa-9ae151e1eb6d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:40.816731 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-79d67cfb-3508-4ec6-b2b8-d22664256552 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:40.824080 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-79d67cfb-3508-4ec6-b2b8-d22664256552 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.159390 Jan 28 02:01:40.833630 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 22/42] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:40 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:40.973328 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0a9db9e2-8c6b-4f4e-b1fa-9ae151e1eb6d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:40.981650 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0a9db9e2-8c6b-4f4e-b1fa-9ae151e1eb6d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.205325 Jan 28 02:01:40.985803 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 21/43] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:40 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:41.028190 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-432f7a7a-29a7-434f-854d-3907197cbe2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:41.028790 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-432f7a7a-29a7-434f-854d-3907197cbe2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:41.040053 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-432f7a7a-29a7-434f-854d-3907197cbe2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:41.040807 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-432f7a7a-29a7-434f-854d-3907197cbe2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:41.041580 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-432f7a7a-29a7-434f-854d-3907197cbe2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:41.042284 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-432f7a7a-29a7-434f-854d-3907197cbe2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:41.112090 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-432f7a7a-29a7-434f-854d-3907197cbe2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:41.120698 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-432f7a7a-29a7-434f-854d-3907197cbe2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:41.122616 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-432f7a7a-29a7-434f-854d-3907197cbe2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:41.123743 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-432f7a7a-29a7-434f-854d-3907197cbe2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1284 microversion: 2.20 time: 0.099283 Jan 28 02:01:41.124302 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 23/44] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:41 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:41.569037 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7a6b72de-684e-401a-9eed-ec7d537dddee tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:41.569647 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7a6b72de-684e-401a-9eed-ec7d537dddee tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:41.575762 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7a6b72de-684e-401a-9eed-ec7d537dddee tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:41.576446 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7a6b72de-684e-401a-9eed-ec7d537dddee tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:41.577391 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7a6b72de-684e-401a-9eed-ec7d537dddee tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:41.578086 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7a6b72de-684e-401a-9eed-ec7d537dddee tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:41.752375 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7a6b72de-684e-401a-9eed-ec7d537dddee tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:41.760926 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7a6b72de-684e-401a-9eed-ec7d537dddee tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.195443 Jan 28 02:01:41.762291 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 22/45] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:41 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:41.840332 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f399eac9-23a5-4635-abec-b0984710a855 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:41.840990 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f399eac9-23a5-4635-abec-b0984710a855 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:41.848845 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f399eac9-23a5-4635-abec-b0984710a855 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:41.849293 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f399eac9-23a5-4635-abec-b0984710a855 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:41.850160 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f399eac9-23a5-4635-abec-b0984710a855 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:41.850633 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f399eac9-23a5-4635-abec-b0984710a855 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:42.001627 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-9175ec00-5352-43b9-8c99-673a5b4f519a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:42.003013 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-9175ec00-5352-43b9-8c99-673a5b4f519a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:42.008134 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-f399eac9-23a5-4635-abec-b0984710a855 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:42.010638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9175ec00-5352-43b9-8c99-673a5b4f519a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:42.011086 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9175ec00-5352-43b9-8c99-673a5b4f519a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:42.012365 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9175ec00-5352-43b9-8c99-673a5b4f519a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:42.013565 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9175ec00-5352-43b9-8c99-673a5b4f519a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:42.022807 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f399eac9-23a5-4635-abec-b0984710a855 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.186000 Jan 28 02:01:42.023800 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 24/46] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:41 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:42.142180 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-aea78292-45be-481a-9bff-ad9a8d38d72d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:42.143166 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-aea78292-45be-481a-9bff-ad9a8d38d72d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:42.149665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aea78292-45be-481a-9bff-ad9a8d38d72d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:42.150392 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aea78292-45be-481a-9bff-ad9a8d38d72d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:42.151458 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aea78292-45be-481a-9bff-ad9a8d38d72d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:42.152360 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aea78292-45be-481a-9bff-ad9a8d38d72d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:42.169673 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-9175ec00-5352-43b9-8c99-673a5b4f519a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:42.199124 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-9175ec00-5352-43b9-8c99-673a5b4f519a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.203860 Jan 28 02:01:42.200067 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 23/47] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:41 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:42.230224 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-aea78292-45be-481a-9bff-ad9a8d38d72d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:42.239152 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-aea78292-45be-481a-9bff-ad9a8d38d72d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:42.240655 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-aea78292-45be-481a-9bff-ad9a8d38d72d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:42.241778 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-aea78292-45be-481a-9bff-ad9a8d38d72d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1284 microversion: 2.20 time: 0.103621 Jan 28 02:01:42.242347 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 25/48] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:42 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:42.779612 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ff4bde80-8f6c-4e30-ab2f-eab4e32a17cc tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:42.779612 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ff4bde80-8f6c-4e30-ab2f-eab4e32a17cc tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:42.794616 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff4bde80-8f6c-4e30-ab2f-eab4e32a17cc tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:42.795254 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff4bde80-8f6c-4e30-ab2f-eab4e32a17cc tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:42.796053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff4bde80-8f6c-4e30-ab2f-eab4e32a17cc tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:42.796493 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff4bde80-8f6c-4e30-ab2f-eab4e32a17cc tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:43.041414 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-33003b9c-21c0-45d5-988c-1ae2042b2fa1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:43.042770 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-33003b9c-21c0-45d5-988c-1ae2042b2fa1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:43.049316 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-33003b9c-21c0-45d5-988c-1ae2042b2fa1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:43.050098 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-33003b9c-21c0-45d5-988c-1ae2042b2fa1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:43.051247 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-33003b9c-21c0-45d5-988c-1ae2042b2fa1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:43.051878 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-33003b9c-21c0-45d5-988c-1ae2042b2fa1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:43.220040 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ff4bde80-8f6c-4e30-ab2f-eab4e32a17cc tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:43.232953 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ff4bde80-8f6c-4e30-ab2f-eab4e32a17cc tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.457772 Jan 28 02:01:43.235060 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 24/49] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:42 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:43.239842 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-575fb01a-f04f-447c-b4af-71e44fdb4f7c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:43.262539 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-575fb01a-f04f-447c-b4af-71e44fdb4f7c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:43.303126 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-575fb01a-f04f-447c-b4af-71e44fdb4f7c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:43.311217 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-575fb01a-f04f-447c-b4af-71e44fdb4f7c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:43.318357 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-575fb01a-f04f-447c-b4af-71e44fdb4f7c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:43.318853 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-575fb01a-f04f-447c-b4af-71e44fdb4f7c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:43.482286 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-33003b9c-21c0-45d5-988c-1ae2042b2fa1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:43.490348 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-33003b9c-21c0-45d5-988c-1ae2042b2fa1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.453760 Jan 28 02:01:43.499362 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 26/50] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:43 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:43.507627 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b4604038-3ce6-475b-b2a2-386a517b5e57 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:43.512259 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b4604038-3ce6-475b-b2a2-386a517b5e57 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:43.537359 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b4604038-3ce6-475b-b2a2-386a517b5e57 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:43.538210 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b4604038-3ce6-475b-b2a2-386a517b5e57 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:43.539227 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b4604038-3ce6-475b-b2a2-386a517b5e57 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:43.539661 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b4604038-3ce6-475b-b2a2-386a517b5e57 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:43.630335 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-575fb01a-f04f-447c-b4af-71e44fdb4f7c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:43.644554 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-575fb01a-f04f-447c-b4af-71e44fdb4f7c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.407856 Jan 28 02:01:43.647707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b4604038-3ce6-475b-b2a2-386a517b5e57 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:43.650115 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 25/51] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:43 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:43.659562 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b4604038-3ce6-475b-b2a2-386a517b5e57 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:43.659562 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b4604038-3ce6-475b-b2a2-386a517b5e57 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:43.659926 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b4604038-3ce6-475b-b2a2-386a517b5e57 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1284 microversion: 2.20 time: 0.157089 Jan 28 02:01:43.660178 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 27/52] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:43 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:44.254521 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8977fdb9-d26f-422f-ae0f-dd8fadad2cd5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:44.255108 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8977fdb9-d26f-422f-ae0f-dd8fadad2cd5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:44.260714 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8977fdb9-d26f-422f-ae0f-dd8fadad2cd5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:44.261150 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8977fdb9-d26f-422f-ae0f-dd8fadad2cd5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:44.261938 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8977fdb9-d26f-422f-ae0f-dd8fadad2cd5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:44.262482 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8977fdb9-d26f-422f-ae0f-dd8fadad2cd5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:44.386684 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8977fdb9-d26f-422f-ae0f-dd8fadad2cd5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:44.394831 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8977fdb9-d26f-422f-ae0f-dd8fadad2cd5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.143703 Jan 28 02:01:44.395150 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 28/53] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:44 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:44.516585 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ccbba81c-3ca7-4874-a806-8f178fd7a5cc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:44.517184 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ccbba81c-3ca7-4874-a806-8f178fd7a5cc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:44.522780 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ccbba81c-3ca7-4874-a806-8f178fd7a5cc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:44.523219 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ccbba81c-3ca7-4874-a806-8f178fd7a5cc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:44.523975 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ccbba81c-3ca7-4874-a806-8f178fd7a5cc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:44.524399 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ccbba81c-3ca7-4874-a806-8f178fd7a5cc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:44.658744 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ccbba81c-3ca7-4874-a806-8f178fd7a5cc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:44.666982 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-bab4174e-0e80-436f-b95e-2e594708bab6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:44.667837 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-bab4174e-0e80-436f-b95e-2e594708bab6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:44.669376 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ccbba81c-3ca7-4874-a806-8f178fd7a5cc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.156907 Jan 28 02:01:44.676938 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bab4174e-0e80-436f-b95e-2e594708bab6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:44.677618 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bab4174e-0e80-436f-b95e-2e594708bab6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:44.678427 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bab4174e-0e80-436f-b95e-2e594708bab6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:44.678980 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bab4174e-0e80-436f-b95e-2e594708bab6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:44.681637 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 26/54] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:44 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:44.686455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7916eb58-a878-49cc-997e-891fa69bd11c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:44.687071 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7916eb58-a878-49cc-997e-891fa69bd11c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:44.693993 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7916eb58-a878-49cc-997e-891fa69bd11c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:44.694671 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7916eb58-a878-49cc-997e-891fa69bd11c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:44.695407 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7916eb58-a878-49cc-997e-891fa69bd11c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:44.695841 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7916eb58-a878-49cc-997e-891fa69bd11c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:44.772838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7916eb58-a878-49cc-997e-891fa69bd11c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:44.780150 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7916eb58-a878-49cc-997e-891fa69bd11c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:44.781832 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7916eb58-a878-49cc-997e-891fa69bd11c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:44.783101 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7916eb58-a878-49cc-997e-891fa69bd11c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1284 microversion: 2.20 time: 0.100455 Jan 28 02:01:44.784156 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 27/55] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:44 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:44.827479 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bab4174e-0e80-436f-b95e-2e594708bab6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:44.834604 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-bab4174e-0e80-436f-b95e-2e594708bab6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.171771 Jan 28 02:01:44.835163 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 29/56] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:44 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:45.411121 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-aea00079-fde5-4332-892e-e7f7bc10fc61 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:45.411730 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-aea00079-fde5-4332-892e-e7f7bc10fc61 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:45.417465 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aea00079-fde5-4332-892e-e7f7bc10fc61 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:45.417959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aea00079-fde5-4332-892e-e7f7bc10fc61 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:45.418727 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aea00079-fde5-4332-892e-e7f7bc10fc61 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:45.419158 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aea00079-fde5-4332-892e-e7f7bc10fc61 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:45.539190 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-aea00079-fde5-4332-892e-e7f7bc10fc61 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:45.546431 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-aea00079-fde5-4332-892e-e7f7bc10fc61 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.139002 Jan 28 02:01:45.546992 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 28/57] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:45 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:45.686802 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-552e2554-cbb0-48a8-bddf-d4c901e6a8e5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:45.687379 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-552e2554-cbb0-48a8-bddf-d4c901e6a8e5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:45.693043 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-552e2554-cbb0-48a8-bddf-d4c901e6a8e5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:45.693486 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-552e2554-cbb0-48a8-bddf-d4c901e6a8e5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:45.694287 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-552e2554-cbb0-48a8-bddf-d4c901e6a8e5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:45.694708 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-552e2554-cbb0-48a8-bddf-d4c901e6a8e5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:45.800080 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-528ec836-895a-4102-94c1-738ccbc6b1e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:45.800681 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-528ec836-895a-4102-94c1-738ccbc6b1e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:45.806464 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-528ec836-895a-4102-94c1-738ccbc6b1e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:45.806909 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-528ec836-895a-4102-94c1-738ccbc6b1e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:45.807674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-528ec836-895a-4102-94c1-738ccbc6b1e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:45.808098 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-528ec836-895a-4102-94c1-738ccbc6b1e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:45.821565 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-552e2554-cbb0-48a8-bddf-d4c901e6a8e5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:45.838392 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-552e2554-cbb0-48a8-bddf-d4c901e6a8e5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.155434 Jan 28 02:01:45.839834 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 30/58] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:45 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:45.857063 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-fcbe0130-8c99-4890-b722-c57b846b60b3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:45.858174 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-fcbe0130-8c99-4890-b722-c57b846b60b3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:45.866081 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fcbe0130-8c99-4890-b722-c57b846b60b3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:45.866767 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fcbe0130-8c99-4890-b722-c57b846b60b3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:45.867968 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fcbe0130-8c99-4890-b722-c57b846b60b3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:45.868618 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fcbe0130-8c99-4890-b722-c57b846b60b3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:45.897332 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-528ec836-895a-4102-94c1-738ccbc6b1e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:45.905165 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-528ec836-895a-4102-94c1-738ccbc6b1e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:45.906922 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-528ec836-895a-4102-94c1-738ccbc6b1e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:45.907910 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-528ec836-895a-4102-94c1-738ccbc6b1e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1284 microversion: 2.20 time: 0.111463 Jan 28 02:01:45.918278 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 29/59] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:45 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:45.999905 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-fcbe0130-8c99-4890-b722-c57b846b60b3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:46.007969 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-fcbe0130-8c99-4890-b722-c57b846b60b3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.155433 Jan 28 02:01:46.008612 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 31/60] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:45 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:46.563896 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f0fb0c52-ea9f-46e0-b497-4b872fe2d1e2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:46.565153 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f0fb0c52-ea9f-46e0-b497-4b872fe2d1e2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:46.572003 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f0fb0c52-ea9f-46e0-b497-4b872fe2d1e2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:46.572467 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f0fb0c52-ea9f-46e0-b497-4b872fe2d1e2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:46.573286 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f0fb0c52-ea9f-46e0-b497-4b872fe2d1e2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:46.573711 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f0fb0c52-ea9f-46e0-b497-4b872fe2d1e2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:46.694552 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f0fb0c52-ea9f-46e0-b497-4b872fe2d1e2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:46.701774 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f0fb0c52-ea9f-46e0-b497-4b872fe2d1e2 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.142240 Jan 28 02:01:46.710866 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 30/61] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:46 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:46.857544 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-26a8c37e-c822-4a45-a2ba-df4d6d72e218 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:46.858277 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-26a8c37e-c822-4a45-a2ba-df4d6d72e218 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:46.866776 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26a8c37e-c822-4a45-a2ba-df4d6d72e218 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:46.867421 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26a8c37e-c822-4a45-a2ba-df4d6d72e218 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:46.868346 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26a8c37e-c822-4a45-a2ba-df4d6d72e218 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:46.869032 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26a8c37e-c822-4a45-a2ba-df4d6d72e218 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:46.926369 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ccbece37-429a-49fa-ab28-78c44b19bb04 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:46.927043 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ccbece37-429a-49fa-ab28-78c44b19bb04 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:46.935432 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ccbece37-429a-49fa-ab28-78c44b19bb04 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:46.936430 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ccbece37-429a-49fa-ab28-78c44b19bb04 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:46.937321 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ccbece37-429a-49fa-ab28-78c44b19bb04 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:46.944631 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ccbece37-429a-49fa-ab28-78c44b19bb04 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:47.021615 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ccbece37-429a-49fa-ab28-78c44b19bb04 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:47.031045 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ccbece37-429a-49fa-ab28-78c44b19bb04 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:47.033395 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ccbece37-429a-49fa-ab28-78c44b19bb04 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:47.034922 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ccbece37-429a-49fa-ab28-78c44b19bb04 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1332 microversion: 2.20 time: 0.113050 Jan 28 02:01:47.035638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 31/62] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:46 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:01:47.036926 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-26a8c37e-c822-4a45-a2ba-df4d6d72e218 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:47.040221 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7852a29f-18c6-4869-8e41-b739f8c4923a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:47.040979 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7852a29f-18c6-4869-8e41-b739f8c4923a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:47.044250 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-26a8c37e-c822-4a45-a2ba-df4d6d72e218 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.191452 Jan 28 02:01:47.044810 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 32/63] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:46 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:47.049455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7852a29f-18c6-4869-8e41-b739f8c4923a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:47.050582 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7852a29f-18c6-4869-8e41-b739f8c4923a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:47.051367 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7852a29f-18c6-4869-8e41-b739f8c4923a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:47.051797 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7852a29f-18c6-4869-8e41-b739f8c4923a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:47.189023 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7852a29f-18c6-4869-8e41-b739f8c4923a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:47.199536 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7852a29f-18c6-4869-8e41-b739f8c4923a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.162736 Jan 28 02:01:47.200108 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 32/64] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:47 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:47.315674 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-0b311271-caad-4ac6-a437-1ceda5b4d5c1 req-47827326-5e5b-4564-aedc-324128d3bcbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d62c44-4ca6-4d5a-bd60-2f5e9e821199", "tag": "74b68811-cff5-4440-b73c-e6a15a359cac"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:47.317243 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:47.317243 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:01:47.335811 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-0b311271-caad-4ac6-a437-1ceda5b4d5c1 req-47827326-5e5b-4564-aedc-324128d3bcbb service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:47.336244 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-0b311271-caad-4ac6-a437-1ceda5b4d5c1 req-47827326-5e5b-4564-aedc-324128d3bcbb service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:47.353448 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-0b311271-caad-4ac6-a437-1ceda5b4d5c1 req-47827326-5e5b-4564-aedc-324128d3bcbb service nova] Creating event network-changed:74b68811-cff5-4440-b73c-e6a15a359cac for instance c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 on hv-cinder-82497 Jan 28 02:01:47.358637 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-0b311271-caad-4ac6-a437-1ceda5b4d5c1 req-47827326-5e5b-4564-aedc-324128d3bcbb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047572 Jan 28 02:01:47.359792 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 33/65] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:47.718245 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6fd55d42-f3ba-4b9f-99cf-cd9c4b24162f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:47.718877 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6fd55d42-f3ba-4b9f-99cf-cd9c4b24162f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:47.724621 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6fd55d42-f3ba-4b9f-99cf-cd9c4b24162f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:47.725068 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6fd55d42-f3ba-4b9f-99cf-cd9c4b24162f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:47.725845 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6fd55d42-f3ba-4b9f-99cf-cd9c4b24162f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:47.726274 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6fd55d42-f3ba-4b9f-99cf-cd9c4b24162f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:47.841376 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6fd55d42-f3ba-4b9f-99cf-cd9c4b24162f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:47.848745 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6fd55d42-f3ba-4b9f-99cf-cd9c4b24162f tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.134080 Jan 28 02:01:47.849320 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 33/66] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:47 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:48.054387 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-bb34fc88-4476-4067-baee-f66a743ca477 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:48.055180 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-bb34fc88-4476-4067-baee-f66a743ca477 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:48.061665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bb34fc88-4476-4067-baee-f66a743ca477 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:48.061994 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-32872c23-c2e8-474c-bf93-a665b90d938d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:48.062257 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bb34fc88-4476-4067-baee-f66a743ca477 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:48.062724 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-32872c23-c2e8-474c-bf93-a665b90d938d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:48.063047 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bb34fc88-4476-4067-baee-f66a743ca477 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:48.063480 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bb34fc88-4476-4067-baee-f66a743ca477 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:48.068593 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-32872c23-c2e8-474c-bf93-a665b90d938d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:48.069027 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-32872c23-c2e8-474c-bf93-a665b90d938d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:48.069796 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-32872c23-c2e8-474c-bf93-a665b90d938d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:48.070219 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-32872c23-c2e8-474c-bf93-a665b90d938d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:48.129372 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bb34fc88-4476-4067-baee-f66a743ca477 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:48.137014 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bb34fc88-4476-4067-baee-f66a743ca477 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:48.138544 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bb34fc88-4476-4067-baee-f66a743ca477 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:48.139629 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-bb34fc88-4476-4067-baee-f66a743ca477 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1332 microversion: 2.20 time: 0.089585 Jan 28 02:01:48.140184 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 34/67] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:48 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:48.203280 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-32872c23-c2e8-474c-bf93-a665b90d938d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:48.212226 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-32872c23-c2e8-474c-bf93-a665b90d938d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.154038 Jan 28 02:01:48.212782 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 34/68] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:48 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:48.216082 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-0472357c-ebcf-4204-888b-ad9272b56097 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:48.216674 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-0472357c-ebcf-4204-888b-ad9272b56097 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:48.223070 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0472357c-ebcf-4204-888b-ad9272b56097 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:48.223521 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0472357c-ebcf-4204-888b-ad9272b56097 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:48.224289 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0472357c-ebcf-4204-888b-ad9272b56097 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:48.224720 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0472357c-ebcf-4204-888b-ad9272b56097 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:48.339212 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-0472357c-ebcf-4204-888b-ad9272b56097 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:48.346765 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-0472357c-ebcf-4204-888b-ad9272b56097 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.134366 Jan 28 02:01:48.347349 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 35/69] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:48 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:48.864942 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7858e820-e6f7-4726-90eb-6731d31f4f6b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:48.865566 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7858e820-e6f7-4726-90eb-6731d31f4f6b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:48.871318 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7858e820-e6f7-4726-90eb-6731d31f4f6b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:48.871784 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7858e820-e6f7-4726-90eb-6731d31f4f6b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:48.872693 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7858e820-e6f7-4726-90eb-6731d31f4f6b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:48.872944 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7858e820-e6f7-4726-90eb-6731d31f4f6b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:49.001579 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7858e820-e6f7-4726-90eb-6731d31f4f6b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:49.009062 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7858e820-e6f7-4726-90eb-6731d31f4f6b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.147723 Jan 28 02:01:49.009651 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 35/70] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:48 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:49.157000 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-472db30c-fd8b-4830-907a-a5395adf8e0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:49.157532 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-472db30c-fd8b-4830-907a-a5395adf8e0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:49.163651 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-472db30c-fd8b-4830-907a-a5395adf8e0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:49.164089 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-472db30c-fd8b-4830-907a-a5395adf8e0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:49.164865 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-472db30c-fd8b-4830-907a-a5395adf8e0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:49.165286 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-472db30c-fd8b-4830-907a-a5395adf8e0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:49.228641 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7d20d9d2-60cd-492f-95a4-541856407d45 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:49.229253 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7d20d9d2-60cd-492f-95a4-541856407d45 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:49.240544 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7d20d9d2-60cd-492f-95a4-541856407d45 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:49.240990 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7d20d9d2-60cd-492f-95a4-541856407d45 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:49.242691 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7d20d9d2-60cd-492f-95a4-541856407d45 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:49.245730 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-472db30c-fd8b-4830-907a-a5395adf8e0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:49.254133 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7d20d9d2-60cd-492f-95a4-541856407d45 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:49.262452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-472db30c-fd8b-4830-907a-a5395adf8e0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:49.264757 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-472db30c-fd8b-4830-907a-a5395adf8e0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:49.277365 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-472db30c-fd8b-4830-907a-a5395adf8e0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1332 microversion: 2.20 time: 0.124134 Jan 28 02:01:49.278535 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 36/71] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:49 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:49.365114 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a6752b08-df1e-4e06-b1d6-fd966a88692c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:49.366353 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a6752b08-df1e-4e06-b1d6-fd966a88692c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:49.373214 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a6752b08-df1e-4e06-b1d6-fd966a88692c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:49.374003 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a6752b08-df1e-4e06-b1d6-fd966a88692c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:49.375812 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a6752b08-df1e-4e06-b1d6-fd966a88692c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:49.376561 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a6752b08-df1e-4e06-b1d6-fd966a88692c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:49.418770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7d20d9d2-60cd-492f-95a4-541856407d45 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:49.428175 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7d20d9d2-60cd-492f-95a4-541856407d45 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.203366 Jan 28 02:01:49.429724 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 36/72] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:49 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:49.441342 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-8014d061-3faf-409c-b672-add13cb9fb85 req-3ed77509-a011-4c63-87a1-63fed0a596db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "706d03a1-cf66-4cdb-8271-bb94ca669ad7", "tag": "37e6d8f1-ff0f-4f83-801f-3e5eb74019e6"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:49.457347 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:49.457347 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:01:49.472197 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-8014d061-3faf-409c-b672-add13cb9fb85 req-3ed77509-a011-4c63-87a1-63fed0a596db service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:49.475412 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-8014d061-3faf-409c-b672-add13cb9fb85 req-3ed77509-a011-4c63-87a1-63fed0a596db service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:49.504709 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-8014d061-3faf-409c-b672-add13cb9fb85 req-3ed77509-a011-4c63-87a1-63fed0a596db service nova] Creating event network-changed:37e6d8f1-ff0f-4f83-801f-3e5eb74019e6 for instance 706d03a1-cf66-4cdb-8271-bb94ca669ad7 on hv-cinder-82497 Jan 28 02:01:49.511306 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-8014d061-3faf-409c-b672-add13cb9fb85 req-3ed77509-a011-4c63-87a1-63fed0a596db service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079723 Jan 28 02:01:49.513385 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 37/73] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:49.536676 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a6752b08-df1e-4e06-b1d6-fd966a88692c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:49.543795 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a6752b08-df1e-4e06-b1d6-fd966a88692c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.182767 Jan 28 02:01:49.544355 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 37/74] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:49 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:50.029185 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-576c00de-dbbe-40e4-b9d8-3ffce37a202a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:50.030714 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-576c00de-dbbe-40e4-b9d8-3ffce37a202a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:50.039313 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-576c00de-dbbe-40e4-b9d8-3ffce37a202a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:50.039768 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-576c00de-dbbe-40e4-b9d8-3ffce37a202a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:50.041136 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-576c00de-dbbe-40e4-b9d8-3ffce37a202a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:50.041476 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-576c00de-dbbe-40e4-b9d8-3ffce37a202a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:50.295018 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ac8a6c2e-8b0f-4f71-a1ca-10e49bdbbc0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:50.295757 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ac8a6c2e-8b0f-4f71-a1ca-10e49bdbbc0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:50.302842 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ac8a6c2e-8b0f-4f71-a1ca-10e49bdbbc0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:50.307118 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ac8a6c2e-8b0f-4f71-a1ca-10e49bdbbc0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:50.307968 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ac8a6c2e-8b0f-4f71-a1ca-10e49bdbbc0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:50.308400 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ac8a6c2e-8b0f-4f71-a1ca-10e49bdbbc0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:50.340445 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-576c00de-dbbe-40e4-b9d8-3ffce37a202a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:50.350201 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-576c00de-dbbe-40e4-b9d8-3ffce37a202a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.324934 Jan 28 02:01:50.361960 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 38/75] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:50 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:50.390378 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ac8a6c2e-8b0f-4f71-a1ca-10e49bdbbc0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:50.399363 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ac8a6c2e-8b0f-4f71-a1ca-10e49bdbbc0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:50.401315 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ac8a6c2e-8b0f-4f71-a1ca-10e49bdbbc0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:50.402448 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ac8a6c2e-8b0f-4f71-a1ca-10e49bdbbc0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1338 microversion: 2.20 time: 0.111225 Jan 28 02:01:50.403478 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 38/76] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:50 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:50.449566 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3a4e5342-bd5f-4ae4-9f6d-afb86129c62a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:50.450279 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3a4e5342-bd5f-4ae4-9f6d-afb86129c62a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:50.462204 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3a4e5342-bd5f-4ae4-9f6d-afb86129c62a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:50.462667 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3a4e5342-bd5f-4ae4-9f6d-afb86129c62a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:50.464038 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3a4e5342-bd5f-4ae4-9f6d-afb86129c62a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:50.464564 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3a4e5342-bd5f-4ae4-9f6d-afb86129c62a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:50.560413 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-252bf21b-5d33-4662-9d24-8e10b933811f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:50.561161 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-252bf21b-5d33-4662-9d24-8e10b933811f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:50.574608 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-252bf21b-5d33-4662-9d24-8e10b933811f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:50.575053 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-252bf21b-5d33-4662-9d24-8e10b933811f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:50.577690 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-252bf21b-5d33-4662-9d24-8e10b933811f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:50.580032 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-252bf21b-5d33-4662-9d24-8e10b933811f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:50.828637 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3a4e5342-bd5f-4ae4-9f6d-afb86129c62a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:50.848330 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3a4e5342-bd5f-4ae4-9f6d-afb86129c62a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.406133 Jan 28 02:01:50.848923 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 39/77] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:50 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:51.020753 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-252bf21b-5d33-4662-9d24-8e10b933811f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:51.030100 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-252bf21b-5d33-4662-9d24-8e10b933811f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.473434 Jan 28 02:01:51.030733 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 39/78] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:50 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:51.369870 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-9350a289-f840-4dc5-8090-8f52fa1dd8cb tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:51.371101 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-9350a289-f840-4dc5-8090-8f52fa1dd8cb tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:51.396637 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9350a289-f840-4dc5-8090-8f52fa1dd8cb tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:51.397092 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9350a289-f840-4dc5-8090-8f52fa1dd8cb tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:51.398002 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9350a289-f840-4dc5-8090-8f52fa1dd8cb tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:51.398428 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9350a289-f840-4dc5-8090-8f52fa1dd8cb tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:51.420242 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7a67dd0a-6686-418d-9d62-c9513ef75538 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:51.420934 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7a67dd0a-6686-418d-9d62-c9513ef75538 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:51.429034 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7a67dd0a-6686-418d-9d62-c9513ef75538 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:51.431413 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7a67dd0a-6686-418d-9d62-c9513ef75538 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:51.432289 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7a67dd0a-6686-418d-9d62-c9513ef75538 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:51.434427 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7a67dd0a-6686-418d-9d62-c9513ef75538 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.166769 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7a67dd0a-6686-418d-9d62-c9513ef75538 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:52.176513 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7a67dd0a-6686-418d-9d62-c9513ef75538 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:52.178824 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7a67dd0a-6686-418d-9d62-c9513ef75538 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:52.180630 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7a67dd0a-6686-418d-9d62-c9513ef75538 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1405 microversion: 2.20 time: 0.764280 Jan 28 02:01:52.181192 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 40/79] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:51 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1405 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:01:52.186800 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-40c00cff-adb6-4072-8509-2bdddeed7f80 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:52.187434 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-40c00cff-adb6-4072-8509-2bdddeed7f80 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:52.192047 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-9350a289-f840-4dc5-8090-8f52fa1dd8cb tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:52.193905 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-40c00cff-adb6-4072-8509-2bdddeed7f80 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.194484 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-40c00cff-adb6-4072-8509-2bdddeed7f80 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.195492 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-40c00cff-adb6-4072-8509-2bdddeed7f80 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.195922 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-40c00cff-adb6-4072-8509-2bdddeed7f80 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.199827 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-9350a289-f840-4dc5-8090-8f52fa1dd8cb tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.835154 Jan 28 02:01:52.200470 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 40/80] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:51 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:52.205723 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-33f97dcf-7ef8-4665-9f29-19817b466d3d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:52.206473 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-33f97dcf-7ef8-4665-9f29-19817b466d3d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:52.212954 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-33f97dcf-7ef8-4665-9f29-19817b466d3d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.213514 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-33f97dcf-7ef8-4665-9f29-19817b466d3d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.214400 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-33f97dcf-7ef8-4665-9f29-19817b466d3d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.215047 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-33f97dcf-7ef8-4665-9f29-19817b466d3d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.587809 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-40c00cff-adb6-4072-8509-2bdddeed7f80 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:52.592038 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-33f97dcf-7ef8-4665-9f29-19817b466d3d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:52.599551 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-40c00cff-adb6-4072-8509-2bdddeed7f80 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.417139 Jan 28 02:01:52.600720 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-33f97dcf-7ef8-4665-9f29-19817b466d3d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.398754 Jan 28 02:01:52.601265 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 41/81] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:52 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:52.601863 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 41/82] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:52 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:52.615407 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-591188c0-e746-4e1c-8f35-d9f59240f12e req-8d2f0ee8-5501-46da-8aed-14dbdd415cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d048580-813a-43b7-ae1a-e0b1a9c8c234", "tag": "1c3eebfc-cf3d-4a86-8be4-2f39da195acf"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:52.617152 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:52.617152 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:01:52.624209 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-591188c0-e746-4e1c-8f35-d9f59240f12e req-8d2f0ee8-5501-46da-8aed-14dbdd415cce service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.624628 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-591188c0-e746-4e1c-8f35-d9f59240f12e req-8d2f0ee8-5501-46da-8aed-14dbdd415cce service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.635858 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-591188c0-e746-4e1c-8f35-d9f59240f12e req-8d2f0ee8-5501-46da-8aed-14dbdd415cce service nova] Creating event network-changed:1c3eebfc-cf3d-4a86-8be4-2f39da195acf for instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234 on hv-cinder-82497 Jan 28 02:01:52.641565 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-591188c0-e746-4e1c-8f35-d9f59240f12e req-8d2f0ee8-5501-46da-8aed-14dbdd415cce service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030420 Jan 28 02:01:52.642189 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 42/83] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:53.200316 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0f07ae14-d170-4c32-9de4-9ed909f1162b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:53.200927 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0f07ae14-d170-4c32-9de4-9ed909f1162b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:53.210902 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0f07ae14-d170-4c32-9de4-9ed909f1162b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.211388 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0f07ae14-d170-4c32-9de4-9ed909f1162b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.214096 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0f07ae14-d170-4c32-9de4-9ed909f1162b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.214537 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0f07ae14-d170-4c32-9de4-9ed909f1162b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.218245 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-dd616c98-87b4-4ac3-a996-adda2758de19 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:53.219135 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-dd616c98-87b4-4ac3-a996-adda2758de19 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:53.230719 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dd616c98-87b4-4ac3-a996-adda2758de19 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.231202 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dd616c98-87b4-4ac3-a996-adda2758de19 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.233067 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dd616c98-87b4-4ac3-a996-adda2758de19 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.233499 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dd616c98-87b4-4ac3-a996-adda2758de19 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.631641 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-dd616c98-87b4-4ac3-a996-adda2758de19 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:53.646101 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-dd616c98-87b4-4ac3-a996-adda2758de19 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.431881 Jan 28 02:01:53.646690 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 43/84] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:53 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:53.659527 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1645974d-57e4-4dcd-acaa-58089f573d7e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:53.660028 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1645974d-57e4-4dcd-acaa-58089f573d7e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:53.671255 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1645974d-57e4-4dcd-acaa-58089f573d7e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.672635 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1645974d-57e4-4dcd-acaa-58089f573d7e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.673596 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1645974d-57e4-4dcd-acaa-58089f573d7e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.674312 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1645974d-57e4-4dcd-acaa-58089f573d7e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.685031 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0f07ae14-d170-4c32-9de4-9ed909f1162b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:53.696665 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0f07ae14-d170-4c32-9de4-9ed909f1162b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:53.698207 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0f07ae14-d170-4c32-9de4-9ed909f1162b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:53.699313 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0f07ae14-d170-4c32-9de4-9ed909f1162b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1405 microversion: 2.20 time: 0.504002 Jan 28 02:01:53.707056 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 42/85] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:53 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1405 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:53.716985 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-625d8c63-bf17-4f44-addf-4457f9b85675 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:53.726294 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-625d8c63-bf17-4f44-addf-4457f9b85675 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:53.741047 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-625d8c63-bf17-4f44-addf-4457f9b85675 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.741483 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-625d8c63-bf17-4f44-addf-4457f9b85675 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.753162 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-625d8c63-bf17-4f44-addf-4457f9b85675 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.753162 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-625d8c63-bf17-4f44-addf-4457f9b85675 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.925427 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-1645974d-57e4-4dcd-acaa-58089f573d7e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:53.935472 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1645974d-57e4-4dcd-acaa-58089f573d7e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.278261 Jan 28 02:01:53.958626 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 44/86] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:53 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:54.095569 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-625d8c63-bf17-4f44-addf-4457f9b85675 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:54.106790 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-625d8c63-bf17-4f44-addf-4457f9b85675 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.398013 Jan 28 02:01:54.109797 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 43/87] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:53 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:54.246339 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-825cb5ed-3389-433a-922e-286b2d65a0ff req-673a4fda-3e87-43ff-97f2-479764468c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7e70ce-ff2e-4323-baec-1455763bb95f", "name": "network-vif-plugged", "status": "completed", "tag": "bdfdebab-1bce-49af-b683-2bf00d7f807c"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:54.248125 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:54.248125 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:01:54.280180 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-825cb5ed-3389-433a-922e-286b2d65a0ff req-673a4fda-3e87-43ff-97f2-479764468c8c service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.280684 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-825cb5ed-3389-433a-922e-286b2d65a0ff req-673a4fda-3e87-43ff-97f2-479764468c8c service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:54.310257 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-825cb5ed-3389-433a-922e-286b2d65a0ff req-673a4fda-3e87-43ff-97f2-479764468c8c service nova] Creating event network-vif-plugged:bdfdebab-1bce-49af-b683-2bf00d7f807c for instance 0c7e70ce-ff2e-4323-baec-1455763bb95f on hv-cinder-82497 Jan 28 02:01:54.317195 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-825cb5ed-3389-433a-922e-286b2d65a0ff req-673a4fda-3e87-43ff-97f2-479764468c8c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166701 Jan 28 02:01:54.318101 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 45/88] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:54.662265 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-14c4f139-6b97-4036-a09c-f812e1d2690a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:54.663257 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-14c4f139-6b97-4036-a09c-f812e1d2690a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:54.670985 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-14c4f139-6b97-4036-a09c-f812e1d2690a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.672170 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-14c4f139-6b97-4036-a09c-f812e1d2690a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:54.673510 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-14c4f139-6b97-4036-a09c-f812e1d2690a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.674652 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-14c4f139-6b97-4036-a09c-f812e1d2690a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:54.722537 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c4516e2a-53b2-4a66-a11a-965a61b9b35e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:54.724151 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c4516e2a-53b2-4a66-a11a-965a61b9b35e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:54.730786 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c4516e2a-53b2-4a66-a11a-965a61b9b35e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.731244 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c4516e2a-53b2-4a66-a11a-965a61b9b35e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:54.732002 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c4516e2a-53b2-4a66-a11a-965a61b9b35e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.732425 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c4516e2a-53b2-4a66-a11a-965a61b9b35e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:55.019465 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-14c4f139-6b97-4036-a09c-f812e1d2690a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:55.030441 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-14c4f139-6b97-4036-a09c-f812e1d2690a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.371744 Jan 28 02:01:55.041286 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 44/89] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:54 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:55.050850 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c4516e2a-53b2-4a66-a11a-965a61b9b35e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:55.061952 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-61a6f9ce-af59-4077-bd15-c7519b535026 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:55.063747 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c4516e2a-53b2-4a66-a11a-965a61b9b35e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:55.064565 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-61a6f9ce-af59-4077-bd15-c7519b535026 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:55.068207 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c4516e2a-53b2-4a66-a11a-965a61b9b35e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:55.072971 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c4516e2a-53b2-4a66-a11a-965a61b9b35e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1405 microversion: 2.20 time: 0.354781 Jan 28 02:01:55.075649 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 46/90] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:54 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1405 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:01:55.076220 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-61a6f9ce-af59-4077-bd15-c7519b535026 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:55.076875 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-61a6f9ce-af59-4077-bd15-c7519b535026 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:55.078310 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-61a6f9ce-af59-4077-bd15-c7519b535026 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:55.079020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-61a6f9ce-af59-4077-bd15-c7519b535026 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:55.124840 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1c39b6f0-8068-4c96-b4bd-6deb34040ac1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:55.125841 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1c39b6f0-8068-4c96-b4bd-6deb34040ac1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:55.133168 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1c39b6f0-8068-4c96-b4bd-6deb34040ac1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:55.134376 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1c39b6f0-8068-4c96-b4bd-6deb34040ac1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:55.135486 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1c39b6f0-8068-4c96-b4bd-6deb34040ac1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:55.136105 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1c39b6f0-8068-4c96-b4bd-6deb34040ac1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:55.285910 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-61a6f9ce-af59-4077-bd15-c7519b535026 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:55.307189 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-61a6f9ce-af59-4077-bd15-c7519b535026 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.251919 Jan 28 02:01:55.308042 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 45/91] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:55 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:55.351945 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-1c39b6f0-8068-4c96-b4bd-6deb34040ac1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:55.359393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1c39b6f0-8068-4c96-b4bd-6deb34040ac1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.238382 Jan 28 02:01:55.360402 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 47/92] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:55 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:56.058572 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-117466ac-1de5-48bd-8d4c-2d78d6305e29 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:56.059350 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-117466ac-1de5-48bd-8d4c-2d78d6305e29 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:56.072864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-117466ac-1de5-48bd-8d4c-2d78d6305e29 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:56.073313 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-117466ac-1de5-48bd-8d4c-2d78d6305e29 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:56.080532 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-117466ac-1de5-48bd-8d4c-2d78d6305e29 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:56.081040 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-117466ac-1de5-48bd-8d4c-2d78d6305e29 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:56.094025 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-38ed1f29-4bd2-4392-9f3c-eea1f92713b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:56.094945 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-38ed1f29-4bd2-4392-9f3c-eea1f92713b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:56.109839 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-38ed1f29-4bd2-4392-9f3c-eea1f92713b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:56.116602 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-38ed1f29-4bd2-4392-9f3c-eea1f92713b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:56.117721 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-38ed1f29-4bd2-4392-9f3c-eea1f92713b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:56.119467 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-38ed1f29-4bd2-4392-9f3c-eea1f92713b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:56.388707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-38ed1f29-4bd2-4392-9f3c-eea1f92713b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:56.400223 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-38ed1f29-4bd2-4392-9f3c-eea1f92713b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:56.406731 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-38ed1f29-4bd2-4392-9f3c-eea1f92713b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:56.410903 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-38ed1f29-4bd2-4392-9f3c-eea1f92713b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1405 microversion: 2.20 time: 0.321338 Jan 28 02:01:56.411111 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-117466ac-1de5-48bd-8d4c-2d78d6305e29 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:56.424288 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-117466ac-1de5-48bd-8d4c-2d78d6305e29 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.378996 Jan 28 02:01:56.424537 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 46/93] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:56 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:56.427295 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 48/94] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:56 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1405 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:56.433877 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-98ddde86-6535-43e6-9d6b-829472d81584 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:56.434383 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-98ddde86-6535-43e6-9d6b-829472d81584 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:56.440797 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8e6ef9d0-b4b8-42e0-9729-550e97fb0d93 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:56.442487 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8e6ef9d0-b4b8-42e0-9729-550e97fb0d93 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:56.454964 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-98ddde86-6535-43e6-9d6b-829472d81584 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:56.458656 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8e6ef9d0-b4b8-42e0-9729-550e97fb0d93 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:56.459260 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8e6ef9d0-b4b8-42e0-9729-550e97fb0d93 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:56.459932 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-98ddde86-6535-43e6-9d6b-829472d81584 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:56.460366 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8e6ef9d0-b4b8-42e0-9729-550e97fb0d93 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:56.461153 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8e6ef9d0-b4b8-42e0-9729-550e97fb0d93 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:56.470077 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-98ddde86-6535-43e6-9d6b-829472d81584 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:56.471873 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-98ddde86-6535-43e6-9d6b-829472d81584 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:56.858643 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8e6ef9d0-b4b8-42e0-9729-550e97fb0d93 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:56.866364 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8e6ef9d0-b4b8-42e0-9729-550e97fb0d93 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1318 microversion: 2.1 time: 0.440845 Jan 28 02:01:56.875700 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 47/95] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:56 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:56.900930 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-98ddde86-6535-43e6-9d6b-829472d81584 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:56.914509 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-98ddde86-6535-43e6-9d6b-829472d81584 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.486120 Jan 28 02:01:56.915104 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 49/96] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:56 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:57.416446 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-fa1826ab-d694-4d3d-9fd9-97f6c0e5f8b6 req-c7c75bc1-3048-4df4-a9c7-9b634298d6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf2b320-c2a2-40d6-afca-73668bda7933", "name": "network-vif-plugged", "status": "completed", "tag": "8221b17d-3386-4e97-a157-ca4c9071392b"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:57.419529 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:57.419529 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:01:57.432809 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-21a0fa0d-7066-4bd6-9bad-193e93902909 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:57.434003 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-21a0fa0d-7066-4bd6-9bad-193e93902909 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:57.434785 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-fa1826ab-d694-4d3d-9fd9-97f6c0e5f8b6 req-c7c75bc1-3048-4df4-a9c7-9b634298d6b1 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.435415 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-fa1826ab-d694-4d3d-9fd9-97f6c0e5f8b6 req-c7c75bc1-3048-4df4-a9c7-9b634298d6b1 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:57.444143 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-21a0fa0d-7066-4bd6-9bad-193e93902909 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.446273 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-21a0fa0d-7066-4bd6-9bad-193e93902909 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:57.447346 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-21a0fa0d-7066-4bd6-9bad-193e93902909 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.449567 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-21a0fa0d-7066-4bd6-9bad-193e93902909 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:57.458794 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-fa1826ab-d694-4d3d-9fd9-97f6c0e5f8b6 req-c7c75bc1-3048-4df4-a9c7-9b634298d6b1 service nova] Creating event network-vif-plugged:8221b17d-3386-4e97-a157-ca4c9071392b for instance aaf2b320-c2a2-40d6-afca-73668bda7933 on hv-cinder-82497 Jan 28 02:01:57.464673 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-fa1826ab-d694-4d3d-9fd9-97f6c0e5f8b6 req-c7c75bc1-3048-4df4-a9c7-9b634298d6b1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052821 Jan 28 02:01:57.465883 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 48/97] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:57.471902 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3e5e81d0-69a7-4bec-8842-113a4043854b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:57.472854 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3e5e81d0-69a7-4bec-8842-113a4043854b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:57.481162 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3e5e81d0-69a7-4bec-8842-113a4043854b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.481940 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3e5e81d0-69a7-4bec-8842-113a4043854b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:57.482944 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3e5e81d0-69a7-4bec-8842-113a4043854b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.504721 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3e5e81d0-69a7-4bec-8842-113a4043854b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:57.654434 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-21a0fa0d-7066-4bd6-9bad-193e93902909 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:57.665618 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-21a0fa0d-7066-4bd6-9bad-193e93902909 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:57.667788 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-21a0fa0d-7066-4bd6-9bad-193e93902909 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:57.669284 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-21a0fa0d-7066-4bd6-9bad-193e93902909 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1405 microversion: 2.20 time: 0.240774 Jan 28 02:01:57.670464 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 50/98] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:57 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1405 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:57.770235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3e5e81d0-69a7-4bec-8842-113a4043854b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:57.782095 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3e5e81d0-69a7-4bec-8842-113a4043854b tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.313032 Jan 28 02:01:57.782931 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 49/99] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:57 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:57.882628 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d57f84a4-b097-4545-89e1-a271f115e5b3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:57.883241 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d57f84a4-b097-4545-89e1-a271f115e5b3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:57.890115 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d57f84a4-b097-4545-89e1-a271f115e5b3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.890597 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d57f84a4-b097-4545-89e1-a271f115e5b3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:57.891378 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d57f84a4-b097-4545-89e1-a271f115e5b3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.891814 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d57f84a4-b097-4545-89e1-a271f115e5b3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:57.931280 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-be6fc1bf-b040-4928-a896-a298f8ab55a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:57.931880 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-be6fc1bf-b040-4928-a896-a298f8ab55a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:57.940208 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be6fc1bf-b040-4928-a896-a298f8ab55a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.940645 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be6fc1bf-b040-4928-a896-a298f8ab55a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:57.941417 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be6fc1bf-b040-4928-a896-a298f8ab55a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.941872 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be6fc1bf-b040-4928-a896-a298f8ab55a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:58.077466 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d57f84a4-b097-4545-89e1-a271f115e5b3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:58.107036 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d57f84a4-b097-4545-89e1-a271f115e5b3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1506 microversion: 2.1 time: 0.222226 Jan 28 02:01:58.107768 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 51/100] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:57 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:58.122864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-be6fc1bf-b040-4928-a896-a298f8ab55a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:58.131511 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-be6fc1bf-b040-4928-a896-a298f8ab55a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.204222 Jan 28 02:01:58.132299 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 50/101] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:57 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:58.692725 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c742bd55-ef79-4b99-ac55-7d3f1c0938ec tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:58.694059 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c742bd55-ef79-4b99-ac55-7d3f1c0938ec tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:58.701297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c742bd55-ef79-4b99-ac55-7d3f1c0938ec tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.701869 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c742bd55-ef79-4b99-ac55-7d3f1c0938ec tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:58.703010 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c742bd55-ef79-4b99-ac55-7d3f1c0938ec tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.704313 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c742bd55-ef79-4b99-ac55-7d3f1c0938ec tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:58.799060 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-35ef6f90-9f39-41b6-b2c3-055347bf7775 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:58.799674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-35ef6f90-9f39-41b6-b2c3-055347bf7775 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:58.807031 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-35ef6f90-9f39-41b6-b2c3-055347bf7775 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.807465 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-35ef6f90-9f39-41b6-b2c3-055347bf7775 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:58.808225 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-35ef6f90-9f39-41b6-b2c3-055347bf7775 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.808647 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-35ef6f90-9f39-41b6-b2c3-055347bf7775 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.002601 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c742bd55-ef79-4b99-ac55-7d3f1c0938ec tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:59.012638 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c742bd55-ef79-4b99-ac55-7d3f1c0938ec tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:59.022457 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c742bd55-ef79-4b99-ac55-7d3f1c0938ec tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:59.022457 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c742bd55-ef79-4b99-ac55-7d3f1c0938ec tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1405 microversion: 2.20 time: 0.333671 Jan 28 02:01:59.022656 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 52/102] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:58 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1405 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:59.091971 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-35ef6f90-9f39-41b6-b2c3-055347bf7775 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:59.106894 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-35ef6f90-9f39-41b6-b2c3-055347bf7775 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1315 microversion: 2.1 time: 0.307065 Jan 28 02:01:59.110159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 51/103] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:58 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:59.148501 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-178a7290-a787-4b65-8706-c02c5f28e501 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:59.149490 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-178a7290-a787-4b65-8706-c02c5f28e501 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:59.155927 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-178a7290-a787-4b65-8706-c02c5f28e501 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:59.157040 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-178a7290-a787-4b65-8706-c02c5f28e501 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.158308 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-178a7290-a787-4b65-8706-c02c5f28e501 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:59.158808 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-178a7290-a787-4b65-8706-c02c5f28e501 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.400772 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-178a7290-a787-4b65-8706-c02c5f28e501 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:59.416748 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-178a7290-a787-4b65-8706-c02c5f28e501 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.272034 Jan 28 02:01:59.418401 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 53/104] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:59 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:59.494997 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-9da81cd6-ace8-40f3-9670-f6cb1de72f65 req-ca6b26f3-9cf6-42ab-a6e0-97495b9a4dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706d03a1-cf66-4cdb-8271-bb94ca669ad7", "name": "network-vif-plugged", "status": "completed", "tag": "37e6d8f1-ff0f-4f83-801f-3e5eb74019e6"}, {"server_uuid": "c8d62c44-4ca6-4d5a-bd60-2f5e9e821199", "name": "network-vif-plugged", "status": "completed", "tag": "74b68811-cff5-4440-b73c-e6a15a359cac"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:59.497149 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:59.497149 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:01:59.518368 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-9da81cd6-ace8-40f3-9670-f6cb1de72f65 req-ca6b26f3-9cf6-42ab-a6e0-97495b9a4dbd service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:59.519050 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-9da81cd6-ace8-40f3-9670-f6cb1de72f65 req-ca6b26f3-9cf6-42ab-a6e0-97495b9a4dbd service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.533161 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-9da81cd6-ace8-40f3-9670-f6cb1de72f65 req-ca6b26f3-9cf6-42ab-a6e0-97495b9a4dbd service nova] Creating event network-vif-plugged:37e6d8f1-ff0f-4f83-801f-3e5eb74019e6 for instance 706d03a1-cf66-4cdb-8271-bb94ca669ad7 on hv-cinder-82497 Jan 28 02:01:59.533904 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-9da81cd6-ace8-40f3-9670-f6cb1de72f65 req-ca6b26f3-9cf6-42ab-a6e0-97495b9a4dbd service nova] Creating event network-vif-plugged:74b68811-cff5-4440-b73c-e6a15a359cac for instance c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 on hv-cinder-82497 Jan 28 02:01:59.541304 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-9da81cd6-ace8-40f3-9670-f6cb1de72f65 req-ca6b26f3-9cf6-42ab-a6e0-97495b9a4dbd service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049769 Jan 28 02:01:59.542478 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 52/105] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:59.692490 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-367b6212-4d8a-492a-9da5-0ed57eee9d97 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0621f8a4-7210-464b-b1a1-fa81b8290dc4"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:59.693720 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-367b6212-4d8a-492a-9da5-0ed57eee9d97 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:59.707936 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-367b6212-4d8a-492a-9da5-0ed57eee9d97 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:59.708426 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-367b6212-4d8a-492a-9da5-0ed57eee9d97 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.709278 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-367b6212-4d8a-492a-9da5-0ed57eee9d97 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:59.709679 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-367b6212-4d8a-492a-9da5-0ed57eee9d97 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.042015 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b8ab2de4-ab14-427b-af4a-681362243ff4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:00.042974 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b8ab2de4-ab14-427b-af4a-681362243ff4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:00.049141 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b8ab2de4-ab14-427b-af4a-681362243ff4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.049670 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b8ab2de4-ab14-427b-af4a-681362243ff4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.050371 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b8ab2de4-ab14-427b-af4a-681362243ff4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.050798 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b8ab2de4-ab14-427b-af4a-681362243ff4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.228339 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b8ab2de4-ab14-427b-af4a-681362243ff4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:00.239143 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b8ab2de4-ab14-427b-af4a-681362243ff4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:00.239143 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b8ab2de4-ab14-427b-af4a-681362243ff4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:00.239334 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b8ab2de4-ab14-427b-af4a-681362243ff4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1405 microversion: 2.20 time: 0.202064 Jan 28 02:02:00.239876 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 53/106] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:00 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:02:00.255200 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-42c8dd31-9243-48bf-b04f-f7c9c1e55fe1 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:00.255798 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-42c8dd31-9243-48bf-b04f-f7c9c1e55fe1 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:00.261582 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-42c8dd31-9243-48bf-b04f-f7c9c1e55fe1 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.262067 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-42c8dd31-9243-48bf-b04f-f7c9c1e55fe1 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.263018 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-42c8dd31-9243-48bf-b04f-f7c9c1e55fe1 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.263448 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-42c8dd31-9243-48bf-b04f-f7c9c1e55fe1 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.397619 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-42c8dd31-9243-48bf-b04f-f7c9c1e55fe1 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:00.405493 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-42c8dd31-9243-48bf-b04f-f7c9c1e55fe1 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1503 microversion: 2.1 time: 0.153694 Jan 28 02:02:00.406176 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 54/107] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:00 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:00.435505 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-45eedfdc-b5c7-43fd-803b-be6298cd7b8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:00.436959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-45eedfdc-b5c7-43fd-803b-be6298cd7b8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:00.446765 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-45eedfdc-b5c7-43fd-803b-be6298cd7b8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.447757 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-45eedfdc-b5c7-43fd-803b-be6298cd7b8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.448733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-45eedfdc-b5c7-43fd-803b-be6298cd7b8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.449340 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-45eedfdc-b5c7-43fd-803b-be6298cd7b8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.629426 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-45eedfdc-b5c7-43fd-803b-be6298cd7b8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:00.643974 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-45eedfdc-b5c7-43fd-803b-be6298cd7b8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.212366 Jan 28 02:02:00.645947 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 55/108] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:00 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:00.972198 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-367b6212-4d8a-492a-9da5-0ed57eee9d97 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "POST /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.284711 Jan 28 02:02:00.973204 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 54/109] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:01:59 2022] POST /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments => generated 194 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:01.258802 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-dc442439-44b1-43c3-91a1-58a003397c78 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:01.259410 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-dc442439-44b1-43c3-91a1-58a003397c78 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:01.267889 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc442439-44b1-43c3-91a1-58a003397c78 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.268321 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc442439-44b1-43c3-91a1-58a003397c78 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.269148 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc442439-44b1-43c3-91a1-58a003397c78 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.269540 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc442439-44b1-43c3-91a1-58a003397c78 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.419782 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dc442439-44b1-43c3-91a1-58a003397c78 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:01.429283 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dc442439-44b1-43c3-91a1-58a003397c78 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:01.431231 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dc442439-44b1-43c3-91a1-58a003397c78 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:01.432979 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-dc442439-44b1-43c3-91a1-58a003397c78 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1405 microversion: 2.20 time: 0.179726 Jan 28 02:02:01.434707 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 56/110] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:01 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:02:01.572764 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-09f57c8d-d2b2-46bc-a0a9-080432ddfec0 req-cde93ba4-70b4-44e7-b7fa-a204bca9f56f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d048580-813a-43b7-ae1a-e0b1a9c8c234", "name": "network-vif-plugged", "status": "completed", "tag": "1c3eebfc-cf3d-4a86-8be4-2f39da195acf"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:01.574686 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:01.574686 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:02:01.587918 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-09f57c8d-d2b2-46bc-a0a9-080432ddfec0 req-cde93ba4-70b4-44e7-b7fa-a204bca9f56f service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.588825 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-09f57c8d-d2b2-46bc-a0a9-080432ddfec0 req-cde93ba4-70b4-44e7-b7fa-a204bca9f56f service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.606068 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-09f57c8d-d2b2-46bc-a0a9-080432ddfec0 req-cde93ba4-70b4-44e7-b7fa-a204bca9f56f service nova] Creating event network-vif-plugged:1c3eebfc-cf3d-4a86-8be4-2f39da195acf for instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234 on hv-cinder-82497 Jan 28 02:02:01.612643 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-09f57c8d-d2b2-46bc-a0a9-080432ddfec0 req-cde93ba4-70b4-44e7-b7fa-a204bca9f56f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044288 Jan 28 02:02:01.618753 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 55/111] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:01.663642 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ff473668-af17-4a86-9475-24f5cbb4fcfc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:01.665198 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ff473668-af17-4a86-9475-24f5cbb4fcfc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:01.677794 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff473668-af17-4a86-9475-24f5cbb4fcfc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.678972 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff473668-af17-4a86-9475-24f5cbb4fcfc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.679641 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff473668-af17-4a86-9475-24f5cbb4fcfc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.680102 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff473668-af17-4a86-9475-24f5cbb4fcfc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.911088 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6e9511e5-73f3-437e-82b3-b234b13a07d0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efeaf556-4bc6-4d1f-9347-fe9bea79849a"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:01.912408 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6e9511e5-73f3-437e-82b3-b234b13a07d0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:01.919013 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6e9511e5-73f3-437e-82b3-b234b13a07d0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.919934 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6e9511e5-73f3-437e-82b3-b234b13a07d0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.921008 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6e9511e5-73f3-437e-82b3-b234b13a07d0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.922177 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6e9511e5-73f3-437e-82b3-b234b13a07d0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:02.020962 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ff473668-af17-4a86-9475-24f5cbb4fcfc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:02.031206 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ff473668-af17-4a86-9475-24f5cbb4fcfc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1321 microversion: 2.1 time: 0.373085 Jan 28 02:02:02.044352 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 57/112] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:01 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:02.382050 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6e9511e5-73f3-437e-82b3-b234b13a07d0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "POST /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.475035 Jan 28 02:02:02.395419 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 56/113] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:02:01 2022] POST /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933/os-volume_attachments => generated 194 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:02.453044 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-05f20c88-b81c-4848-ac8f-ba71fffdea4c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:02.454184 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-05f20c88-b81c-4848-ac8f-ba71fffdea4c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:02.462938 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-05f20c88-b81c-4848-ac8f-ba71fffdea4c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:02.466868 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-05f20c88-b81c-4848-ac8f-ba71fffdea4c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:02.468205 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-05f20c88-b81c-4848-ac8f-ba71fffdea4c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:02.469807 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-05f20c88-b81c-4848-ac8f-ba71fffdea4c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:02.726747 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-05f20c88-b81c-4848-ac8f-ba71fffdea4c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:02.739228 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-05f20c88-b81c-4848-ac8f-ba71fffdea4c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:02.741075 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-05f20c88-b81c-4848-ac8f-ba71fffdea4c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:02.742386 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-05f20c88-b81c-4848-ac8f-ba71fffdea4c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1405 microversion: 2.20 time: 0.294392 Jan 28 02:02:02.743404 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 58/114] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:02 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1405 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:02:03.053267 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ed04b383-8d78-427d-ad90-1fdf5708524a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:03.054418 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ed04b383-8d78-427d-ad90-1fdf5708524a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:03.060683 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ed04b383-8d78-427d-ad90-1fdf5708524a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.061392 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ed04b383-8d78-427d-ad90-1fdf5708524a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.062955 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ed04b383-8d78-427d-ad90-1fdf5708524a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.063386 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ed04b383-8d78-427d-ad90-1fdf5708524a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.227712 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ed04b383-8d78-427d-ad90-1fdf5708524a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:03.238338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ed04b383-8d78-427d-ad90-1fdf5708524a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1516 microversion: 2.1 time: 0.194397 Jan 28 02:02:03.242462 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 57/115] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:03 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:03.262331 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-69ec0934-3a3e-45c6-8d5c-9d91e6c5c4f2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:03.263339 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-69ec0934-3a3e-45c6-8d5c-9d91e6c5c4f2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:03.272658 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-69ec0934-3a3e-45c6-8d5c-9d91e6c5c4f2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.273127 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-69ec0934-3a3e-45c6-8d5c-9d91e6c5c4f2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.274739 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-69ec0934-3a3e-45c6-8d5c-9d91e6c5c4f2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.274834 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-69ec0934-3a3e-45c6-8d5c-9d91e6c5c4f2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.382512 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-69ec0934-3a3e-45c6-8d5c-9d91e6c5c4f2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lazy-loading 'flavor' on Instance uuid c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:02:03.558574 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-69ec0934-3a3e-45c6-8d5c-9d91e6c5c4f2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "POST /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199/action" status: 200 len: 32 microversion: 2.1 time: 0.301878 Jan 28 02:02:03.566404 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 59/116] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:03 2022] POST /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199/action => generated 32 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:02:03.571683 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c5032a3a-a263-4934-8530-cd4c629a2ecc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:03.575483 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c5032a3a-a263-4934-8530-cd4c629a2ecc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:03.590630 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c5032a3a-a263-4934-8530-cd4c629a2ecc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.593018 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c5032a3a-a263-4934-8530-cd4c629a2ecc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.594755 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c5032a3a-a263-4934-8530-cd4c629a2ecc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.596306 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c5032a3a-a263-4934-8530-cd4c629a2ecc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.760077 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c5032a3a-a263-4934-8530-cd4c629a2ecc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:03.765144 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-32a8ad7c-77b8-43d8-8c4a-d22239e52580 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:03.769268 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-32a8ad7c-77b8-43d8-8c4a-d22239e52580 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:03.778657 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-32a8ad7c-77b8-43d8-8c4a-d22239e52580 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.779104 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-32a8ad7c-77b8-43d8-8c4a-d22239e52580 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.779883 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-32a8ad7c-77b8-43d8-8c4a-d22239e52580 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.780319 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-32a8ad7c-77b8-43d8-8c4a-d22239e52580 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.786557 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c5032a3a-a263-4934-8530-cd4c629a2ecc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.217379 Jan 28 02:02:03.787158 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 58/117] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:03 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:03.964068 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-32a8ad7c-77b8-43d8-8c4a-d22239e52580 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:03.974837 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-32a8ad7c-77b8-43d8-8c4a-d22239e52580 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:03.976548 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-32a8ad7c-77b8-43d8-8c4a-d22239e52580 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:03.977728 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-32a8ad7c-77b8-43d8-8c4a-d22239e52580 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1597 microversion: 2.20 time: 0.220099 Jan 28 02:02:03.978308 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 60/118] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:03 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1597 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:02:03.999505 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4948e961-0612-4613-9c08-c09ee8a2bad1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:04.000217 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4948e961-0612-4613-9c08-c09ee8a2bad1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:04.011345 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4948e961-0612-4613-9c08-c09ee8a2bad1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:04.014683 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4948e961-0612-4613-9c08-c09ee8a2bad1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:04.014683 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4948e961-0612-4613-9c08-c09ee8a2bad1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:04.014683 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4948e961-0612-4613-9c08-c09ee8a2bad1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:04.123882 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4948e961-0612-4613-9c08-c09ee8a2bad1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.128027 Jan 28 02:02:04.124456 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 59/119] 10.222.0.77 () {60 vars in 1315 bytes} [Fri Jan 28 02:02:03 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:02:04.805710 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2b5e9ac3-5b88-404d-9147-4ef0230da569 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:04.806607 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-2b5e9ac3-5b88-404d-9147-4ef0230da569 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:04.822053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b5e9ac3-5b88-404d-9147-4ef0230da569 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:04.855131 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b5e9ac3-5b88-404d-9147-4ef0230da569 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:04.857097 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b5e9ac3-5b88-404d-9147-4ef0230da569 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:04.868448 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b5e9ac3-5b88-404d-9147-4ef0230da569 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:05.582387 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-2b5e9ac3-5b88-404d-9147-4ef0230da569 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:05.598102 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2b5e9ac3-5b88-404d-9147-4ef0230da569 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.794663 Jan 28 02:02:05.602077 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 61/120] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:04 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:06.047899 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-1f8ee484-55c1-487c-88dd-606f37d86522 req-c5b0c0af-f7ef-4c58-983a-21180c65ff8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d048580-813a-43b7-ae1a-e0b1a9c8c234", "tag": "1c3eebfc-cf3d-4a86-8be4-2f39da195acf"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:06.050097 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-93c60332-fa95-4ef3-80a1-c78236d975d3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:06.051306 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:06.051306 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:02:06.052631 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-93c60332-fa95-4ef3-80a1-c78236d975d3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:06.062596 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-93c60332-fa95-4ef3-80a1-c78236d975d3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:06.063686 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-1f8ee484-55c1-487c-88dd-606f37d86522 req-c5b0c0af-f7ef-4c58-983a-21180c65ff8e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:06.064012 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-93c60332-fa95-4ef3-80a1-c78236d975d3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:06.064143 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-1f8ee484-55c1-487c-88dd-606f37d86522 req-c5b0c0af-f7ef-4c58-983a-21180c65ff8e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:06.065768 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-93c60332-fa95-4ef3-80a1-c78236d975d3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:06.067889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-93c60332-fa95-4ef3-80a1-c78236d975d3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:06.079401 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-1f8ee484-55c1-487c-88dd-606f37d86522 req-c5b0c0af-f7ef-4c58-983a-21180c65ff8e service nova] Creating event network-changed:1c3eebfc-cf3d-4a86-8be4-2f39da195acf for instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234 on hv-cinder-82497 Jan 28 02:02:06.085510 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-1f8ee484-55c1-487c-88dd-606f37d86522 req-c5b0c0af-f7ef-4c58-983a-21180c65ff8e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041078 Jan 28 02:02:06.086778 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 62/121] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:06.238010 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-93c60332-fa95-4ef3-80a1-c78236d975d3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 14 microversion: 2.20 time: 0.198629 Jan 28 02:02:06.241793 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 60/122] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:06 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:06.620538 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1b230c3f-5d67-45a7-9bee-e905f40967a1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:06.621244 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1b230c3f-5d67-45a7-9bee-e905f40967a1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:06.635734 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b230c3f-5d67-45a7-9bee-e905f40967a1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:06.636176 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b230c3f-5d67-45a7-9bee-e905f40967a1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:06.637295 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b230c3f-5d67-45a7-9bee-e905f40967a1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:06.637718 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b230c3f-5d67-45a7-9bee-e905f40967a1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:06.875859 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1b230c3f-5d67-45a7-9bee-e905f40967a1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:06.886223 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1b230c3f-5d67-45a7-9bee-e905f40967a1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.269634 Jan 28 02:02:06.886812 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 63/123] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:06 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:07.257140 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6b6e9a28-9f13-418a-8f11-a51c0a0ca769 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:07.261434 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6b6e9a28-9f13-418a-8f11-a51c0a0ca769 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:07.270306 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b6e9a28-9f13-418a-8f11-a51c0a0ca769 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:07.270306 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b6e9a28-9f13-418a-8f11-a51c0a0ca769 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:07.270306 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b6e9a28-9f13-418a-8f11-a51c0a0ca769 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:07.270306 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b6e9a28-9f13-418a-8f11-a51c0a0ca769 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:07.405204 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6b6e9a28-9f13-418a-8f11-a51c0a0ca769 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 14 microversion: 2.20 time: 0.160111 Jan 28 02:02:07.406490 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 61/124] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:07 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:07.902581 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c77b70eb-71f8-4e68-8fe8-d7899601c2e1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:07.903198 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c77b70eb-71f8-4e68-8fe8-d7899601c2e1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:07.914203 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c77b70eb-71f8-4e68-8fe8-d7899601c2e1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:07.914817 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c77b70eb-71f8-4e68-8fe8-d7899601c2e1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:07.915726 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c77b70eb-71f8-4e68-8fe8-d7899601c2e1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:07.916218 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c77b70eb-71f8-4e68-8fe8-d7899601c2e1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:08.039235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c77b70eb-71f8-4e68-8fe8-d7899601c2e1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:08.047361 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c77b70eb-71f8-4e68-8fe8-d7899601c2e1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.148386 Jan 28 02:02:08.047925 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 64/125] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:07 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:08.416819 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c1bf2535-0719-43ca-ad54-da0c0610248d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:08.417825 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c1bf2535-0719-43ca-ad54-da0c0610248d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:08.425527 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c1bf2535-0719-43ca-ad54-da0c0610248d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:08.425856 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c1bf2535-0719-43ca-ad54-da0c0610248d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:08.426652 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c1bf2535-0719-43ca-ad54-da0c0610248d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:08.427072 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c1bf2535-0719-43ca-ad54-da0c0610248d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:08.534799 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c1bf2535-0719-43ca-ad54-da0c0610248d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 14 microversion: 2.20 time: 0.121672 Jan 28 02:02:08.535359 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 62/126] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:08 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:09.064855 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-367b1eab-6bfa-4a2f-81e1-4b567e781c84 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:09.065480 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-367b1eab-6bfa-4a2f-81e1-4b567e781c84 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:09.071364 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-367b1eab-6bfa-4a2f-81e1-4b567e781c84 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:09.071801 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-367b1eab-6bfa-4a2f-81e1-4b567e781c84 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:09.072544 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-367b1eab-6bfa-4a2f-81e1-4b567e781c84 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:09.072964 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-367b1eab-6bfa-4a2f-81e1-4b567e781c84 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:09.191701 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-367b1eab-6bfa-4a2f-81e1-4b567e781c84 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:09.198860 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-367b1eab-6bfa-4a2f-81e1-4b567e781c84 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.138756 Jan 28 02:02:09.199422 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 65/127] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:09 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:09.546210 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ff5772a3-cb68-4087-99e0-cac81652dd88 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:09.547850 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ff5772a3-cb68-4087-99e0-cac81652dd88 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:09.555650 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ff5772a3-cb68-4087-99e0-cac81652dd88 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:09.556176 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ff5772a3-cb68-4087-99e0-cac81652dd88 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:09.557073 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ff5772a3-cb68-4087-99e0-cac81652dd88 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:09.557616 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ff5772a3-cb68-4087-99e0-cac81652dd88 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:09.702159 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ff5772a3-cb68-4087-99e0-cac81652dd88 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 14 microversion: 2.20 time: 0.159987 Jan 28 02:02:09.702787 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 63/128] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:09 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:10.215300 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-51d023c2-1ae2-45f7-8cbe-466009f605bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:10.215906 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-51d023c2-1ae2-45f7-8cbe-466009f605bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:10.222330 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-51d023c2-1ae2-45f7-8cbe-466009f605bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:10.222770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-51d023c2-1ae2-45f7-8cbe-466009f605bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:10.223524 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-51d023c2-1ae2-45f7-8cbe-466009f605bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:10.223952 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-51d023c2-1ae2-45f7-8cbe-466009f605bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:10.344569 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-51d023c2-1ae2-45f7-8cbe-466009f605bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:10.351640 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-51d023c2-1ae2-45f7-8cbe-466009f605bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.140090 Jan 28 02:02:10.352196 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 66/129] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:10 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:10.712701 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-bf22422b-e4e1-4dc6-a8b7-fd7418aeddb3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:10.713680 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-bf22422b-e4e1-4dc6-a8b7-fd7418aeddb3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:10.719991 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bf22422b-e4e1-4dc6-a8b7-fd7418aeddb3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:10.720430 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bf22422b-e4e1-4dc6-a8b7-fd7418aeddb3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:10.721217 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bf22422b-e4e1-4dc6-a8b7-fd7418aeddb3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:10.721641 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bf22422b-e4e1-4dc6-a8b7-fd7418aeddb3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:10.965810 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-72116444", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "networks": [{"uuid": "a12a014d-4a71-408b-a943-054c73574ed9"}]}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:11.016108 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.network.neutron [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] validate_networks() for [('a12a014d-4a71-408b-a943-054c73574ed9', None, None, None, None, None)] {{(pid=115761) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:02:11.361284 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Flavor limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:02:11.361801 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Image limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:02:11.362209 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Flavor pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:02:11.362604 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Image pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:02:11.363273 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:02:11.371844 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:11.372290 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:11.373073 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:11.373491 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:11.390158 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Getting quotas for project 6639261ee8ee46e0a4e3a01eb63b9ab4. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:02:11.398067 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Getting quotas for user 9717e2ab2be74631aba4b196112bf984 and project 6639261ee8ee46e0a4e3a01eb63b9ab4. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:02:11.409096 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Going to run 1 instances... {{(pid=115761) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:02:11.411476 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:02:11.455349 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f113517f-93da-4510-9987-d8aa1d227196 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493118 Jan 28 02:02:11.456196 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 67/130] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:02:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 02:02:11.460595 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2b86687c-39a2-4642-ac51-bbda0f0be753 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:11.461442 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-2b86687c-39a2-4642-ac51-bbda0f0be753 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:11.467213 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b86687c-39a2-4642-ac51-bbda0f0be753 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:11.467654 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b86687c-39a2-4642-ac51-bbda0f0be753 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:11.468901 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b86687c-39a2-4642-ac51-bbda0f0be753 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:11.469329 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b86687c-39a2-4642-ac51-bbda0f0be753 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:11.596132 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-2b86687c-39a2-4642-ac51-bbda0f0be753 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:11.603349 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2b86687c-39a2-4642-ac51-bbda0f0be753 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.146111 Jan 28 02:02:11.603906 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 68/131] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:11 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:11.608072 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-74d5baf9-9b23-4544-91cf-7531daedee85 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:11.608652 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-74d5baf9-9b23-4544-91cf-7531daedee85 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:11.661293 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-74d5baf9-9b23-4544-91cf-7531daedee85 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:11.667644 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-74d5baf9-9b23-4544-91cf-7531daedee85 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1216 microversion: 2.1 time: 0.062757 Jan 28 02:02:11.668131 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 69/132] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:11 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1216 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:12.620347 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-dbf1e007-9220-45f7-8b7a-e51926191aa3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:12.620958 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-dbf1e007-9220-45f7-8b7a-e51926191aa3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:12.627652 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dbf1e007-9220-45f7-8b7a-e51926191aa3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:12.628093 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dbf1e007-9220-45f7-8b7a-e51926191aa3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:12.628845 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dbf1e007-9220-45f7-8b7a-e51926191aa3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:12.629275 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dbf1e007-9220-45f7-8b7a-e51926191aa3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:12.746317 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dbf1e007-9220-45f7-8b7a-e51926191aa3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:12.754392 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-dbf1e007-9220-45f7-8b7a-e51926191aa3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.137704 Jan 28 02:02:12.754948 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 70/133] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:12 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:12.759088 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bf3819cf-af94-4730-8d2b-b60c452cc3ec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:12.759682 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bf3819cf-af94-4730-8d2b-b60c452cc3ec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:12.765180 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bf3819cf-af94-4730-8d2b-b60c452cc3ec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:12.765627 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bf3819cf-af94-4730-8d2b-b60c452cc3ec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:12.766424 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bf3819cf-af94-4730-8d2b-b60c452cc3ec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:12.766850 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bf3819cf-af94-4730-8d2b-b60c452cc3ec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:12.826690 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-bf3819cf-af94-4730-8d2b-b60c452cc3ec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:12.833825 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-bf3819cf-af94-4730-8d2b-b60c452cc3ec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1220 microversion: 2.1 time: 0.077912 Jan 28 02:02:12.834379 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 71/134] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:12 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:13.076058 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-bf22422b-e4e1-4dc6-a8b7-fd7418aeddb3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 14 microversion: 2.20 time: 2.367107 Jan 28 02:02:13.079508 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 64/135] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:10 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 14 bytes in 2372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:13.771420 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8118af43-f5d0-4b8a-9919-6db73c794c5b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:13.772012 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8118af43-f5d0-4b8a-9919-6db73c794c5b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:13.779891 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8118af43-f5d0-4b8a-9919-6db73c794c5b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:13.780403 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8118af43-f5d0-4b8a-9919-6db73c794c5b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:13.781959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8118af43-f5d0-4b8a-9919-6db73c794c5b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:13.782573 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8118af43-f5d0-4b8a-9919-6db73c794c5b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:13.852133 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4369d23d-6cc0-4241-9896-1a31352b92e3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:13.852858 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4369d23d-6cc0-4241-9896-1a31352b92e3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:13.868200 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4369d23d-6cc0-4241-9896-1a31352b92e3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:13.868897 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4369d23d-6cc0-4241-9896-1a31352b92e3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:13.869668 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4369d23d-6cc0-4241-9896-1a31352b92e3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:13.870157 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4369d23d-6cc0-4241-9896-1a31352b92e3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:13.984914 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4369d23d-6cc0-4241-9896-1a31352b92e3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:13.990188 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8118af43-f5d0-4b8a-9919-6db73c794c5b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:13.993519 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4369d23d-6cc0-4241-9896-1a31352b92e3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1276 microversion: 2.1 time: 0.145550 Jan 28 02:02:13.994456 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 65/136] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:13 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:14.008515 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8118af43-f5d0-4b8a-9919-6db73c794c5b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.241268 Jan 28 02:02:14.009171 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 72/137] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:13 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:14.087509 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-96831f87-8f2b-4c0f-8d75-7356f88d99b2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:14.088427 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-96831f87-8f2b-4c0f-8d75-7356f88d99b2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:14.094198 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-96831f87-8f2b-4c0f-8d75-7356f88d99b2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:14.094902 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-96831f87-8f2b-4c0f-8d75-7356f88d99b2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:14.096080 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-96831f87-8f2b-4c0f-8d75-7356f88d99b2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:14.096291 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-96831f87-8f2b-4c0f-8d75-7356f88d99b2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:14.205697 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-96831f87-8f2b-4c0f-8d75-7356f88d99b2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 14 microversion: 2.20 time: 0.121626 Jan 28 02:02:14.209510 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 66/138] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:14 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:15.013398 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6ea8f5cc-fe3d-4a2b-88ea-d6cea0d313c1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:15.019058 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6ea8f5cc-fe3d-4a2b-88ea-d6cea0d313c1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:15.025321 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-53ef5d1c-cf32-4583-ad46-105ce7bded3a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:15.026015 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-53ef5d1c-cf32-4583-ad46-105ce7bded3a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:15.027365 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6ea8f5cc-fe3d-4a2b-88ea-d6cea0d313c1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:15.028973 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6ea8f5cc-fe3d-4a2b-88ea-d6cea0d313c1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:15.031599 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6ea8f5cc-fe3d-4a2b-88ea-d6cea0d313c1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:15.032188 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6ea8f5cc-fe3d-4a2b-88ea-d6cea0d313c1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:15.036194 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-53ef5d1c-cf32-4583-ad46-105ce7bded3a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:15.036833 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-53ef5d1c-cf32-4583-ad46-105ce7bded3a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:15.039549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-53ef5d1c-cf32-4583-ad46-105ce7bded3a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:15.040111 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-53ef5d1c-cf32-4583-ad46-105ce7bded3a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:15.224586 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6ea8f5cc-fe3d-4a2b-88ea-d6cea0d313c1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:15.231568 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-53ef5d1c-cf32-4583-ad46-105ce7bded3a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:15.238584 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6ea8f5cc-fe3d-4a2b-88ea-d6cea0d313c1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.229947 Jan 28 02:02:15.239141 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 73/139] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:15 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:15.239425 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-53ef5d1c-cf32-4583-ad46-105ce7bded3a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.218518 Jan 28 02:02:15.240260 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 67/140] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:15 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:15.244145 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-29e5880f-2452-4470-8999-f75c9628b4fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:15.245105 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-29e5880f-2452-4470-8999-f75c9628b4fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:15.257710 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-29e5880f-2452-4470-8999-f75c9628b4fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:15.257823 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-29e5880f-2452-4470-8999-f75c9628b4fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:15.258627 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-29e5880f-2452-4470-8999-f75c9628b4fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:15.259154 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-29e5880f-2452-4470-8999-f75c9628b4fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:15.420020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-29e5880f-2452-4470-8999-f75c9628b4fd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 14 microversion: 2.20 time: 0.179332 Jan 28 02:02:15.420650 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 74/141] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:15 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:15.984006 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-f17cafab-1ee9-4f8e-8ad4-27f384e41a6e req-ca63847f-7e65-45e6-b515-6926cfd9bb3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4151aa9-3199-4737-9677-a6eb2d6237df", "tag": "bad03cd4-410c-4cad-9815-8cc25c949359"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:15.986135 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:15.986135 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:02:16.003221 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-f17cafab-1ee9-4f8e-8ad4-27f384e41a6e req-ca63847f-7e65-45e6-b515-6926cfd9bb3b service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:16.003730 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-f17cafab-1ee9-4f8e-8ad4-27f384e41a6e req-ca63847f-7e65-45e6-b515-6926cfd9bb3b service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:16.022237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-f17cafab-1ee9-4f8e-8ad4-27f384e41a6e req-ca63847f-7e65-45e6-b515-6926cfd9bb3b service nova] Creating event network-changed:bad03cd4-410c-4cad-9815-8cc25c949359 for instance c4151aa9-3199-4737-9677-a6eb2d6237df on hv-cinder-82497 Jan 28 02:02:16.027555 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-f17cafab-1ee9-4f8e-8ad4-27f384e41a6e req-ca63847f-7e65-45e6-b515-6926cfd9bb3b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047995 Jan 28 02:02:16.028698 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 68/142] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:16.261160 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b9698758-9aec-4233-a1ba-a935fa0d3834 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:16.261978 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b9698758-9aec-4233-a1ba-a935fa0d3834 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:16.269245 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b9698758-9aec-4233-a1ba-a935fa0d3834 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:16.269706 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b9698758-9aec-4233-a1ba-a935fa0d3834 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:16.270645 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b9698758-9aec-4233-a1ba-a935fa0d3834 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:16.271079 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b9698758-9aec-4233-a1ba-a935fa0d3834 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:16.276741 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a0fffefa-53df-46e3-be22-c1232519ddc7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:16.278567 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a0fffefa-53df-46e3-be22-c1232519ddc7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:16.286914 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a0fffefa-53df-46e3-be22-c1232519ddc7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:16.287625 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a0fffefa-53df-46e3-be22-c1232519ddc7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:16.288673 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a0fffefa-53df-46e3-be22-c1232519ddc7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:16.289281 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a0fffefa-53df-46e3-be22-c1232519ddc7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:16.486747 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b9698758-9aec-4233-a1ba-a935fa0d3834 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:16.493305 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a0fffefa-53df-46e3-be22-c1232519ddc7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:16.496856 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b9698758-9aec-4233-a1ba-a935fa0d3834 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.239915 Jan 28 02:02:16.502601 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a0fffefa-53df-46e3-be22-c1232519ddc7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.238066 Jan 28 02:02:16.503418 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 69/143] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:16 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:16.507405 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 75/144] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:16 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:16.508350 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-18cf4528-12fa-4907-9e78-e05e9941ee53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:16.509273 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-18cf4528-12fa-4907-9e78-e05e9941ee53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:16.515201 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-18cf4528-12fa-4907-9e78-e05e9941ee53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:16.515682 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-18cf4528-12fa-4907-9e78-e05e9941ee53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:16.516445 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-18cf4528-12fa-4907-9e78-e05e9941ee53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:16.516877 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-18cf4528-12fa-4907-9e78-e05e9941ee53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:16.710743 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-18cf4528-12fa-4907-9e78-e05e9941ee53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 14 microversion: 2.20 time: 0.205775 Jan 28 02:02:16.711357 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 70/145] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:16 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:17.520265 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c3012a15-47e5-4e38-84c1-08f0719093ae tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:17.520954 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c3012a15-47e5-4e38-84c1-08f0719093ae tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:17.526850 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-16ccd22b-8358-4e03-b56a-1b752f45a332 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:17.527953 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-16ccd22b-8358-4e03-b56a-1b752f45a332 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:17.534501 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-16ccd22b-8358-4e03-b56a-1b752f45a332 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:17.535945 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-16ccd22b-8358-4e03-b56a-1b752f45a332 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:17.536965 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c3012a15-47e5-4e38-84c1-08f0719093ae tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:17.539071 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c3012a15-47e5-4e38-84c1-08f0719093ae tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:17.539879 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-16ccd22b-8358-4e03-b56a-1b752f45a332 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:17.540319 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-16ccd22b-8358-4e03-b56a-1b752f45a332 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:17.550174 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c3012a15-47e5-4e38-84c1-08f0719093ae tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:17.550717 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c3012a15-47e5-4e38-84c1-08f0719093ae tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:17.795549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c3012a15-47e5-4e38-84c1-08f0719093ae tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:17.801942 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-16ccd22b-8358-4e03-b56a-1b752f45a332 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:17.804461 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c3012a15-47e5-4e38-84c1-08f0719093ae tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.288002 Jan 28 02:02:17.809099 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-16ccd22b-8358-4e03-b56a-1b752f45a332 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.298750 Jan 28 02:02:17.809821 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 76/146] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:17 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:17.819076 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 71/147] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:17 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:17.823227 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8ff7b710-2c10-4c9e-9b7d-82be02c58971 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:17.824783 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8ff7b710-2c10-4c9e-9b7d-82be02c58971 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:17.831894 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8ff7b710-2c10-4c9e-9b7d-82be02c58971 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:17.832343 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8ff7b710-2c10-4c9e-9b7d-82be02c58971 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:17.833627 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8ff7b710-2c10-4c9e-9b7d-82be02c58971 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:17.834111 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8ff7b710-2c10-4c9e-9b7d-82be02c58971 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:17.972529 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8ff7b710-2c10-4c9e-9b7d-82be02c58971 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 14 microversion: 2.20 time: 0.154818 Jan 28 02:02:17.976603 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 72/148] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:17 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:18.822285 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-380e1e0c-c05c-4364-9c7a-ec90525b1044 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:18.823044 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-380e1e0c-c05c-4364-9c7a-ec90525b1044 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:18.828835 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9722bd16-d46a-4c63-be7e-a2bcb7515a52 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:18.830773 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9722bd16-d46a-4c63-be7e-a2bcb7515a52 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:18.832552 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-380e1e0c-c05c-4364-9c7a-ec90525b1044 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:18.833547 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-380e1e0c-c05c-4364-9c7a-ec90525b1044 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:18.835188 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-380e1e0c-c05c-4364-9c7a-ec90525b1044 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:18.836060 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-380e1e0c-c05c-4364-9c7a-ec90525b1044 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:18.840986 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9722bd16-d46a-4c63-be7e-a2bcb7515a52 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:18.841721 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9722bd16-d46a-4c63-be7e-a2bcb7515a52 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:18.843050 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9722bd16-d46a-4c63-be7e-a2bcb7515a52 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:18.844014 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9722bd16-d46a-4c63-be7e-a2bcb7515a52 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:19.043995 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-380e1e0c-c05c-4364-9c7a-ec90525b1044 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:19.050669 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9722bd16-d46a-4c63-be7e-a2bcb7515a52 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:19.053221 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-380e1e0c-c05c-4364-9c7a-ec90525b1044 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.234195 Jan 28 02:02:19.054150 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 77/149] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:18 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:19.060068 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-9b2f2bff-87b7-40a8-aace-efe8a8de6157 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:19.061162 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-9b2f2bff-87b7-40a8-aace-efe8a8de6157 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:19.069041 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9b2f2bff-87b7-40a8-aace-efe8a8de6157 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:19.069776 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9b2f2bff-87b7-40a8-aace-efe8a8de6157 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:19.070991 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9b2f2bff-87b7-40a8-aace-efe8a8de6157 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:19.071770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9b2f2bff-87b7-40a8-aace-efe8a8de6157 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:19.079201 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9722bd16-d46a-4c63-be7e-a2bcb7515a52 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.255216 Jan 28 02:02:19.079833 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 73/150] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:18 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:19.208345 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-9b2f2bff-87b7-40a8-aace-efe8a8de6157 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 14 microversion: 2.20 time: 0.152696 Jan 28 02:02:19.208984 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 78/151] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:19 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:20.072110 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d51598e7-34c7-464f-b514-165cba59a00b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:20.072853 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d51598e7-34c7-464f-b514-165cba59a00b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:20.079464 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d51598e7-34c7-464f-b514-165cba59a00b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.080169 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d51598e7-34c7-464f-b514-165cba59a00b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.081414 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d51598e7-34c7-464f-b514-165cba59a00b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.081866 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d51598e7-34c7-464f-b514-165cba59a00b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.096291 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8ea0fa70-6f88-43a0-9a89-e0c5b3e1749c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:20.096988 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8ea0fa70-6f88-43a0-9a89-e0c5b3e1749c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:20.103784 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8ea0fa70-6f88-43a0-9a89-e0c5b3e1749c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.104239 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8ea0fa70-6f88-43a0-9a89-e0c5b3e1749c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.105020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8ea0fa70-6f88-43a0-9a89-e0c5b3e1749c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.105447 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8ea0fa70-6f88-43a0-9a89-e0c5b3e1749c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.511784 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d51598e7-34c7-464f-b514-165cba59a00b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:20.519592 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d51598e7-34c7-464f-b514-165cba59a00b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.451988 Jan 28 02:02:20.520440 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 74/152] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:20 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:20.526745 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8ea0fa70-6f88-43a0-9a89-e0c5b3e1749c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:20.528674 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-dcacbc2b-6600-48b1-aee4-10e3ccca17e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:20.529782 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-dcacbc2b-6600-48b1-aee4-10e3ccca17e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:20.534597 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8ea0fa70-6f88-43a0-9a89-e0c5b3e1749c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.442187 Jan 28 02:02:20.535450 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 79/153] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:20 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:20.538192 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dcacbc2b-6600-48b1-aee4-10e3ccca17e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.538678 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dcacbc2b-6600-48b1-aee4-10e3ccca17e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.539474 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dcacbc2b-6600-48b1-aee4-10e3ccca17e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.540052 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dcacbc2b-6600-48b1-aee4-10e3ccca17e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.672029 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-dcacbc2b-6600-48b1-aee4-10e3ccca17e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 14 microversion: 2.20 time: 0.150137 Jan 28 02:02:20.672786 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 75/154] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:20 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:20.956898 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c0bf89a5-2cd7-413a-acb0-0353a286082a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:20.957392 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c0bf89a5-2cd7-413a-acb0-0353a286082a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:20.963149 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c0bf89a5-2cd7-413a-acb0-0353a286082a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.963588 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c0bf89a5-2cd7-413a-acb0-0353a286082a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.964341 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c0bf89a5-2cd7-413a-acb0-0353a286082a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.964769 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c0bf89a5-2cd7-413a-acb0-0353a286082a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.988922 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c0bf89a5-2cd7-413a-acb0-0353a286082a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Going to try to terminate instance {{(pid=115761) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:02:21.070905 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c0bf89a5-2cd7-413a-acb0-0353a286082a tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "DELETE /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 204 len: 0 microversion: 2.1 time: 0.117412 Jan 28 02:02:21.072251 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 80/155] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:02:20 2022] DELETE /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:02:21.081286 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6205ff0d-bc9a-477a-b175-608144b3579c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:21.082045 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6205ff0d-bc9a-477a-b175-608144b3579c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:21.087997 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6205ff0d-bc9a-477a-b175-608144b3579c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.088444 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6205ff0d-bc9a-477a-b175-608144b3579c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.089209 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6205ff0d-bc9a-477a-b175-608144b3579c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.089641 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6205ff0d-bc9a-477a-b175-608144b3579c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.211939 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6205ff0d-bc9a-477a-b175-608144b3579c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:21.220413 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6205ff0d-bc9a-477a-b175-608144b3579c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1555 microversion: 2.1 time: 0.143962 Jan 28 02:02:21.221457 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 76/156] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:21 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:21.537337 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d6047b82-3d27-4b13-91aa-1a4bf59b9f31 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:21.538056 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d6047b82-3d27-4b13-91aa-1a4bf59b9f31 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:21.544407 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d6047b82-3d27-4b13-91aa-1a4bf59b9f31 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.544846 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d6047b82-3d27-4b13-91aa-1a4bf59b9f31 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.545669 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d6047b82-3d27-4b13-91aa-1a4bf59b9f31 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.546168 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d6047b82-3d27-4b13-91aa-1a4bf59b9f31 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.563126 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d291de7b-3907-48ee-9f48-0c5138e92fc4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:21.564054 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d291de7b-3907-48ee-9f48-0c5138e92fc4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:21.570758 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d291de7b-3907-48ee-9f48-0c5138e92fc4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.571338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d291de7b-3907-48ee-9f48-0c5138e92fc4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.572252 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d291de7b-3907-48ee-9f48-0c5138e92fc4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.572782 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d291de7b-3907-48ee-9f48-0c5138e92fc4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.736894 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d6047b82-3d27-4b13-91aa-1a4bf59b9f31 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:21.743758 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d291de7b-3907-48ee-9f48-0c5138e92fc4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:21.744347 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d6047b82-3d27-4b13-91aa-1a4bf59b9f31 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.211015 Jan 28 02:02:21.744920 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 81/157] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:21 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:21.749704 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a34e2f7b-6a52-47e0-8a06-0c89a8ceff8b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:21.750807 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a34e2f7b-6a52-47e0-8a06-0c89a8ceff8b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:21.751679 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d291de7b-3907-48ee-9f48-0c5138e92fc4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.203895 Jan 28 02:02:21.752315 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 77/158] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:21 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:21.756521 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a34e2f7b-6a52-47e0-8a06-0c89a8ceff8b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.756968 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a34e2f7b-6a52-47e0-8a06-0c89a8ceff8b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.757779 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a34e2f7b-6a52-47e0-8a06-0c89a8ceff8b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.758209 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a34e2f7b-6a52-47e0-8a06-0c89a8ceff8b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:22.238169 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-185bc558-6e4b-45ac-8189-8efaa5f20575 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:22.238789 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-185bc558-6e4b-45ac-8189-8efaa5f20575 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:22.245061 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-185bc558-6e4b-45ac-8189-8efaa5f20575 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.245497 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-185bc558-6e4b-45ac-8189-8efaa5f20575 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:22.246276 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-185bc558-6e4b-45ac-8189-8efaa5f20575 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.246697 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-185bc558-6e4b-45ac-8189-8efaa5f20575 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:22.365320 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-185bc558-6e4b-45ac-8189-8efaa5f20575 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:22.373023 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-185bc558-6e4b-45ac-8189-8efaa5f20575 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1555 microversion: 2.1 time: 0.139027 Jan 28 02:02:22.373702 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 78/159] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:22 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1555 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:22.760045 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-22f96566-bd6e-42d9-98da-25f723c714a8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:22.760652 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-22f96566-bd6e-42d9-98da-25f723c714a8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:22.766439 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-22f96566-bd6e-42d9-98da-25f723c714a8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.766881 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-22f96566-bd6e-42d9-98da-25f723c714a8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:22.767635 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-22f96566-bd6e-42d9-98da-25f723c714a8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.768060 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-22f96566-bd6e-42d9-98da-25f723c714a8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:22.884262 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-22f96566-bd6e-42d9-98da-25f723c714a8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:22.891340 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-22f96566-bd6e-42d9-98da-25f723c714a8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.134914 Jan 28 02:02:22.891939 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 79/160] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:22 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:22.896088 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-121a6292-0dd8-49cb-9e1b-859e54cb908a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:22.896677 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-121a6292-0dd8-49cb-9e1b-859e54cb908a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:22.901925 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-121a6292-0dd8-49cb-9e1b-859e54cb908a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.902365 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-121a6292-0dd8-49cb-9e1b-859e54cb908a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:22.903115 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-121a6292-0dd8-49cb-9e1b-859e54cb908a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.903542 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-121a6292-0dd8-49cb-9e1b-859e54cb908a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:23.023772 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-121a6292-0dd8-49cb-9e1b-859e54cb908a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:23.031784 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-121a6292-0dd8-49cb-9e1b-859e54cb908a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.138866 Jan 28 02:02:23.032352 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 80/161] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:22 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:23.391268 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d5fd9e25-1ddc-4f04-83cb-f40b1c1cffb0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:23.391891 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d5fd9e25-1ddc-4f04-83cb-f40b1c1cffb0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:23.397638 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d5fd9e25-1ddc-4f04-83cb-f40b1c1cffb0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:23.398118 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d5fd9e25-1ddc-4f04-83cb-f40b1c1cffb0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:23.398870 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d5fd9e25-1ddc-4f04-83cb-f40b1c1cffb0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:23.399292 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d5fd9e25-1ddc-4f04-83cb-f40b1c1cffb0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:23.520962 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d5fd9e25-1ddc-4f04-83cb-f40b1c1cffb0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:23.528633 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d5fd9e25-1ddc-4f04-83cb-f40b1c1cffb0 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1555 microversion: 2.1 time: 0.141606 Jan 28 02:02:23.529130 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 81/162] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:23 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1555 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:23.907734 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2eddfeaf-18a5-4127-80a7-097b64c06425 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:23.908328 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2eddfeaf-18a5-4127-80a7-097b64c06425 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:23.914200 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2eddfeaf-18a5-4127-80a7-097b64c06425 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:23.914638 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2eddfeaf-18a5-4127-80a7-097b64c06425 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:23.915388 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2eddfeaf-18a5-4127-80a7-097b64c06425 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:23.915815 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2eddfeaf-18a5-4127-80a7-097b64c06425 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.037659 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-2eddfeaf-18a5-4127-80a7-097b64c06425 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:24.044888 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2eddfeaf-18a5-4127-80a7-097b64c06425 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.140801 Jan 28 02:02:24.045389 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 82/163] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:23 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:24.050251 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d5a94ca6-ce9e-4bce-9520-c84081e48932 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:24.050848 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d5a94ca6-ce9e-4bce-9520-c84081e48932 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:24.056208 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d5a94ca6-ce9e-4bce-9520-c84081e48932 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.056682 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d5a94ca6-ce9e-4bce-9520-c84081e48932 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.057504 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d5a94ca6-ce9e-4bce-9520-c84081e48932 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.057964 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d5a94ca6-ce9e-4bce-9520-c84081e48932 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.135233 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a34e2f7b-6a52-47e0-8a06-0c89a8ceff8b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 14 microversion: 2.20 time: 2.389039 Jan 28 02:02:24.138448 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 82/164] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:21 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 14 bytes in 2390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:24.178406 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d5a94ca6-ce9e-4bce-9520-c84081e48932 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:24.185453 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d5a94ca6-ce9e-4bce-9520-c84081e48932 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.139114 Jan 28 02:02:24.186039 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 83/165] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:24 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:24.546032 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c9877858-7afe-4ab9-b04e-798a8b443373 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:24.546744 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c9877858-7afe-4ab9-b04e-798a8b443373 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:24.552982 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c9877858-7afe-4ab9-b04e-798a8b443373 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.553427 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c9877858-7afe-4ab9-b04e-798a8b443373 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.554224 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c9877858-7afe-4ab9-b04e-798a8b443373 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.554707 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c9877858-7afe-4ab9-b04e-798a8b443373 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.684007 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c9877858-7afe-4ab9-b04e-798a8b443373 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:24.692000 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c9877858-7afe-4ab9-b04e-798a8b443373 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1555 microversion: 2.1 time: 0.150347 Jan 28 02:02:24.692552 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 83/166] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:24 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:25.062770 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-091736cb-79ad-4a88-a0ab-a22153ac5a3a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:25.064074 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-091736cb-79ad-4a88-a0ab-a22153ac5a3a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:25.070658 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-091736cb-79ad-4a88-a0ab-a22153ac5a3a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.071406 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-091736cb-79ad-4a88-a0ab-a22153ac5a3a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.072274 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-091736cb-79ad-4a88-a0ab-a22153ac5a3a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.072708 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-091736cb-79ad-4a88-a0ab-a22153ac5a3a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.147618 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1b5b4edb-2076-4474-be32-575e55092107 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:25.148593 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1b5b4edb-2076-4474-be32-575e55092107 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:25.156489 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b5b4edb-2076-4474-be32-575e55092107 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.156900 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b5b4edb-2076-4474-be32-575e55092107 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.158053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b5b4edb-2076-4474-be32-575e55092107 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.158500 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b5b4edb-2076-4474-be32-575e55092107 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.220135 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-091736cb-79ad-4a88-a0ab-a22153ac5a3a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:25.227785 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-091736cb-79ad-4a88-a0ab-a22153ac5a3a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.169613 Jan 28 02:02:25.228325 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 84/167] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:25 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:25.232895 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c4eeb349-389d-4ba8-b204-2a1ee91a475c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:25.234268 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c4eeb349-389d-4ba8-b204-2a1ee91a475c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:25.241851 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c4eeb349-389d-4ba8-b204-2a1ee91a475c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.242292 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c4eeb349-389d-4ba8-b204-2a1ee91a475c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.243059 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c4eeb349-389d-4ba8-b204-2a1ee91a475c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.243484 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c4eeb349-389d-4ba8-b204-2a1ee91a475c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.364540 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c4eeb349-389d-4ba8-b204-2a1ee91a475c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:25.372235 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c4eeb349-389d-4ba8-b204-2a1ee91a475c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.142682 Jan 28 02:02:25.372854 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 85/168] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:25 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:25.708192 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8fcffdc5-b6f4-4f71-be6e-129c0c0ccf38 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:25.709149 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8fcffdc5-b6f4-4f71-be6e-129c0c0ccf38 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:25.725976 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8fcffdc5-b6f4-4f71-be6e-129c0c0ccf38 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.726487 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8fcffdc5-b6f4-4f71-be6e-129c0c0ccf38 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.727413 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8fcffdc5-b6f4-4f71-be6e-129c0c0ccf38 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.727838 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8fcffdc5-b6f4-4f71-be6e-129c0c0ccf38 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:26.059885 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8fcffdc5-b6f4-4f71-be6e-129c0c0ccf38 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:26.071335 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8fcffdc5-b6f4-4f71-be6e-129c0c0ccf38 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1555 microversion: 2.1 time: 0.364482 Jan 28 02:02:26.071931 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 86/169] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:25 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1555 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:26.245496 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f419af20-6178-4f5e-8750-8ea1a58190cb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:26.246140 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f419af20-6178-4f5e-8750-8ea1a58190cb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:26.252472 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f419af20-6178-4f5e-8750-8ea1a58190cb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:26.252917 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f419af20-6178-4f5e-8750-8ea1a58190cb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:26.254248 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f419af20-6178-4f5e-8750-8ea1a58190cb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:26.254691 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f419af20-6178-4f5e-8750-8ea1a58190cb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:26.430476 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-f419af20-6178-4f5e-8750-8ea1a58190cb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:26.438746 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f419af20-6178-4f5e-8750-8ea1a58190cb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.196972 Jan 28 02:02:26.439496 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 87/170] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:26 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:26.443861 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-dc1dae9a-3c63-4fd4-8fec-99119f9201cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:26.444742 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-dc1dae9a-3c63-4fd4-8fec-99119f9201cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:26.450923 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dc1dae9a-3c63-4fd4-8fec-99119f9201cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:26.451405 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dc1dae9a-3c63-4fd4-8fec-99119f9201cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:26.452196 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dc1dae9a-3c63-4fd4-8fec-99119f9201cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:26.453294 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dc1dae9a-3c63-4fd4-8fec-99119f9201cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:26.573513 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-dc1dae9a-3c63-4fd4-8fec-99119f9201cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:26.581946 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-dc1dae9a-3c63-4fd4-8fec-99119f9201cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.141212 Jan 28 02:02:26.582509 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 88/171] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:26 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:27.089024 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8b5c5fac-c320-474d-8f33-c67c1b64493d tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:27.090354 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8b5c5fac-c320-474d-8f33-c67c1b64493d tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:27.097549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8b5c5fac-c320-474d-8f33-c67c1b64493d tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.098150 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8b5c5fac-c320-474d-8f33-c67c1b64493d tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.105153 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8b5c5fac-c320-474d-8f33-c67c1b64493d tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.105729 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8b5c5fac-c320-474d-8f33-c67c1b64493d tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.231069 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8b5c5fac-c320-474d-8f33-c67c1b64493d tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:27.239811 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8b5c5fac-c320-474d-8f33-c67c1b64493d tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1555 microversion: 2.1 time: 0.154376 Jan 28 02:02:27.240439 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 89/172] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:27 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:27.244793 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-789c5b28-0e3b-450a-99b2-5babff0637b5 req-e674c541-743f-4d00-ad88-016430d449c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4151aa9-3199-4737-9677-a6eb2d6237df", "name": "network-vif-plugged", "status": "completed", "tag": "bad03cd4-410c-4cad-9815-8cc25c949359"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:27.246519 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:27.246519 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:02:27.255414 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-789c5b28-0e3b-450a-99b2-5babff0637b5 req-e674c541-743f-4d00-ad88-016430d449c0 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.255940 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-789c5b28-0e3b-450a-99b2-5babff0637b5 req-e674c541-743f-4d00-ad88-016430d449c0 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.266881 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-789c5b28-0e3b-450a-99b2-5babff0637b5 req-e674c541-743f-4d00-ad88-016430d449c0 service nova] Creating event network-vif-plugged:bad03cd4-410c-4cad-9815-8cc25c949359 for instance c4151aa9-3199-4737-9677-a6eb2d6237df on hv-cinder-82497 Jan 28 02:02:27.272723 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-789c5b28-0e3b-450a-99b2-5babff0637b5 req-e674c541-743f-4d00-ad88-016430d449c0 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031072 Jan 28 02:02:27.273574 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 90/173] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:27.457403 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-aa3c10d7-a4a1-4530-b927-7db3add98cb4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:27.458810 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-aa3c10d7-a4a1-4530-b927-7db3add98cb4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:27.467117 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aa3c10d7-a4a1-4530-b927-7db3add98cb4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.467644 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aa3c10d7-a4a1-4530-b927-7db3add98cb4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.469180 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aa3c10d7-a4a1-4530-b927-7db3add98cb4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.469787 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aa3c10d7-a4a1-4530-b927-7db3add98cb4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.598539 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-aa3c10d7-a4a1-4530-b927-7db3add98cb4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:27.605772 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-aa3c10d7-a4a1-4530-b927-7db3add98cb4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.153915 Jan 28 02:02:27.606335 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 91/174] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:27 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:27.610541 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a340846b-6f1b-4905-bd62-a98d51538ae3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:27.611133 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a340846b-6f1b-4905-bd62-a98d51538ae3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:27.616676 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a340846b-6f1b-4905-bd62-a98d51538ae3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.617123 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a340846b-6f1b-4905-bd62-a98d51538ae3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.617909 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a340846b-6f1b-4905-bd62-a98d51538ae3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.618336 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a340846b-6f1b-4905-bd62-a98d51538ae3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.736374 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a340846b-6f1b-4905-bd62-a98d51538ae3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:27.743833 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a340846b-6f1b-4905-bd62-a98d51538ae3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.136574 Jan 28 02:02:27.744458 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 92/175] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:27 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:28.093151 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1b5b4edb-2076-4474-be32-575e55092107 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 15297 microversion: 2.20 time: 2.949706 Jan 28 02:02:28.093831 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 84/176] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:25 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 15297 bytes in 2951 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:28.259870 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5f28d2df-8e99-47ae-bbf5-7b011bd10f97 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:28.260395 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5f28d2df-8e99-47ae-bbf5-7b011bd10f97 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:28.266259 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5f28d2df-8e99-47ae-bbf5-7b011bd10f97 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:28.266709 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5f28d2df-8e99-47ae-bbf5-7b011bd10f97 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:28.267483 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5f28d2df-8e99-47ae-bbf5-7b011bd10f97 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:28.267915 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5f28d2df-8e99-47ae-bbf5-7b011bd10f97 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:28.385741 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5f28d2df-8e99-47ae-bbf5-7b011bd10f97 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:28.393422 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5f28d2df-8e99-47ae-bbf5-7b011bd10f97 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1555 microversion: 2.1 time: 0.137634 Jan 28 02:02:28.394020 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 93/177] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:28 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:28.623252 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1089f364-29d2-475e-a18e-77b706e80ad0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:28.623965 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1089f364-29d2-475e-a18e-77b706e80ad0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:28.631371 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1089f364-29d2-475e-a18e-77b706e80ad0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:28.631916 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1089f364-29d2-475e-a18e-77b706e80ad0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:28.632687 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1089f364-29d2-475e-a18e-77b706e80ad0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:28.633118 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1089f364-29d2-475e-a18e-77b706e80ad0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:28.760740 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-12d30fb3-9c41-4e57-ae2e-78c4582bb014 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:28.761336 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-12d30fb3-9c41-4e57-ae2e-78c4582bb014 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:28.766638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1089f364-29d2-475e-a18e-77b706e80ad0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:28.767438 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-12d30fb3-9c41-4e57-ae2e-78c4582bb014 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:28.767745 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-12d30fb3-9c41-4e57-ae2e-78c4582bb014 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:28.768507 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-12d30fb3-9c41-4e57-ae2e-78c4582bb014 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:28.768927 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-12d30fb3-9c41-4e57-ae2e-78c4582bb014 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:28.776129 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1089f364-29d2-475e-a18e-77b706e80ad0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.156728 Jan 28 02:02:28.776720 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 85/178] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:28 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:28.929528 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-12d30fb3-9c41-4e57-ae2e-78c4582bb014 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:28.944272 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-12d30fb3-9c41-4e57-ae2e-78c4582bb014 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.187431 Jan 28 02:02:28.956593 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 94/179] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:28 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:29.104764 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1ebc55e3-e072-4381-ae0a-667a9a532714 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:29.105668 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1ebc55e3-e072-4381-ae0a-667a9a532714 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:29.111871 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1ebc55e3-e072-4381-ae0a-667a9a532714 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.112370 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1ebc55e3-e072-4381-ae0a-667a9a532714 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.113295 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1ebc55e3-e072-4381-ae0a-667a9a532714 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.113814 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1ebc55e3-e072-4381-ae0a-667a9a532714 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.288145 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1ebc55e3-e072-4381-ae0a-667a9a532714 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 17808 microversion: 2.20 time: 0.187075 Jan 28 02:02:29.288714 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 86/180] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:29 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 17808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:29.409636 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c0e88949-5779-4965-b97e-63bb1af268ad tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:29.410251 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c0e88949-5779-4965-b97e-63bb1af268ad tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:29.416444 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c0e88949-5779-4965-b97e-63bb1af268ad tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.416877 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c0e88949-5779-4965-b97e-63bb1af268ad tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.417623 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c0e88949-5779-4965-b97e-63bb1af268ad tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.418081 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c0e88949-5779-4965-b97e-63bb1af268ad tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.541599 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c0e88949-5779-4965-b97e-63bb1af268ad tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:29.550510 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c0e88949-5779-4965-b97e-63bb1af268ad tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1555 microversion: 2.1 time: 0.144379 Jan 28 02:02:29.551296 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 95/181] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:29 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:29.793424 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-af4e50bd-8910-4469-9154-9a6bfaa02f77 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:29.794054 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-af4e50bd-8910-4469-9154-9a6bfaa02f77 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:29.801106 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-af4e50bd-8910-4469-9154-9a6bfaa02f77 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.801717 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-af4e50bd-8910-4469-9154-9a6bfaa02f77 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.802869 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-af4e50bd-8910-4469-9154-9a6bfaa02f77 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.803486 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-af4e50bd-8910-4469-9154-9a6bfaa02f77 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.937596 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-af4e50bd-8910-4469-9154-9a6bfaa02f77 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:29.945000 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-af4e50bd-8910-4469-9154-9a6bfaa02f77 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1316 microversion: 2.1 time: 0.155803 Jan 28 02:02:29.945633 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 87/182] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:29 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:29.973289 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e8f0e5c3-ea6b-4283-8724-5caa649b997f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:29.973975 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e8f0e5c3-ea6b-4283-8724-5caa649b997f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:29.979876 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e8f0e5c3-ea6b-4283-8724-5caa649b997f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.980314 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e8f0e5c3-ea6b-4283-8724-5caa649b997f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.981060 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e8f0e5c3-ea6b-4283-8724-5caa649b997f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.981481 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e8f0e5c3-ea6b-4283-8724-5caa649b997f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:30.115910 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-e8f0e5c3-ea6b-4283-8724-5caa649b997f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:30.123270 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-e8f0e5c3-ea6b-4283-8724-5caa649b997f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.153620 Jan 28 02:02:30.123838 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 96/183] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:29 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:30.299295 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-17712904-c4ae-4359-9c14-242a2f1a4b6a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:30.300209 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-17712904-c4ae-4359-9c14-242a2f1a4b6a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:30.305921 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-17712904-c4ae-4359-9c14-242a2f1a4b6a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:30.306377 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-17712904-c4ae-4359-9c14-242a2f1a4b6a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:30.307130 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-17712904-c4ae-4359-9c14-242a2f1a4b6a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:30.307556 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-17712904-c4ae-4359-9c14-242a2f1a4b6a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:30.520393 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-17712904-c4ae-4359-9c14-242a2f1a4b6a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 17808 microversion: 2.20 time: 0.224554 Jan 28 02:02:30.521024 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 88/184] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:30 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 17808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:30.568401 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-872a589f-dbb9-4a43-bc8c-48fedf39c2d5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:30.568933 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-872a589f-dbb9-4a43-bc8c-48fedf39c2d5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:30.574709 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-872a589f-dbb9-4a43-bc8c-48fedf39c2d5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:30.575149 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-872a589f-dbb9-4a43-bc8c-48fedf39c2d5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:30.575917 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-872a589f-dbb9-4a43-bc8c-48fedf39c2d5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:30.576439 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-872a589f-dbb9-4a43-bc8c-48fedf39c2d5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:30.729174 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-872a589f-dbb9-4a43-bc8c-48fedf39c2d5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:30.737609 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-872a589f-dbb9-4a43-bc8c-48fedf39c2d5 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1555 microversion: 2.1 time: 0.173106 Jan 28 02:02:30.738201 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 97/185] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:30 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:30.963098 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-599408c1-2da4-4388-8c98-646bda7f1f6d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:30.964517 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-599408c1-2da4-4388-8c98-646bda7f1f6d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:30.971301 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-599408c1-2da4-4388-8c98-646bda7f1f6d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:30.971879 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-599408c1-2da4-4388-8c98-646bda7f1f6d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:30.972774 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-599408c1-2da4-4388-8c98-646bda7f1f6d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:30.973284 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-599408c1-2da4-4388-8c98-646bda7f1f6d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.122763 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-599408c1-2da4-4388-8c98-646bda7f1f6d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:31.131888 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-599408c1-2da4-4388-8c98-646bda7f1f6d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1504 microversion: 2.1 time: 0.172930 Jan 28 02:02:31.132454 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 89/186] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:30 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:31.146094 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-eacb8753-ce1e-4fed-9d5f-f410a0ce2b9d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:31.146911 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-eacb8753-ce1e-4fed-9d5f-f410a0ce2b9d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:31.155865 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bb4dbdc1-263d-4f59-b3c7-2f3090cc0c23 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0621f8a4-7210-464b-b1a1-fa81b8290dc4"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:31.157345 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bb4dbdc1-263d-4f59-b3c7-2f3090cc0c23 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:31.165197 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bb4dbdc1-263d-4f59-b3c7-2f3090cc0c23 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.166059 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bb4dbdc1-263d-4f59-b3c7-2f3090cc0c23 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.167102 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bb4dbdc1-263d-4f59-b3c7-2f3090cc0c23 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.167683 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bb4dbdc1-263d-4f59-b3c7-2f3090cc0c23 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.169601 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eacb8753-ce1e-4fed-9d5f-f410a0ce2b9d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.170200 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eacb8753-ce1e-4fed-9d5f-f410a0ce2b9d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.171612 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eacb8753-ce1e-4fed-9d5f-f410a0ce2b9d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.174165 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eacb8753-ce1e-4fed-9d5f-f410a0ce2b9d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.348380 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-bb4dbdc1-263d-4f59-b3c7-2f3090cc0c23 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] HTTP exception thrown: Invalid volume: volume 0621f8a4-7210-464b-b1a1-fa81b8290dc4 is already attached to instances: 0c7e70ce-ff2e-4323-baec-1455763bb95f Jan 28 02:02:31.349882 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bb4dbdc1-263d-4f59-b3c7-2f3090cc0c23 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Returning 400 to user: Invalid volume: volume 0621f8a4-7210-464b-b1a1-fa81b8290dc4 is already attached to instances: 0c7e70ce-ff2e-4323-baec-1455763bb95f {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:31.351387 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-bb4dbdc1-263d-4f59-b3c7-2f3090cc0c23 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "POST /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.206666 Jan 28 02:02:31.352387 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 90/187] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:02:31 2022] POST /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df/os-volume_attachments => generated 174 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:02:31.362759 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-a9708d09-1a79-4ab3-8e44-174a8472f4ee req-d27568af-ee51-440d-8803-ceb1d2bdfe55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf2b320-c2a2-40d6-afca-73668bda7933", "name": "network-vif-deleted", "tag": "8221b17d-3386-4e97-a157-ca4c9071392b"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:31.365677 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:31.365677 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:02:31.402063 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-a9708d09-1a79-4ab3-8e44-174a8472f4ee req-d27568af-ee51-440d-8803-ceb1d2bdfe55 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.403255 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-a9708d09-1a79-4ab3-8e44-174a8472f4ee req-d27568af-ee51-440d-8803-ceb1d2bdfe55 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.422778 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-a9708d09-1a79-4ab3-8e44-174a8472f4ee req-d27568af-ee51-440d-8803-ceb1d2bdfe55 service nova] Creating event network-vif-deleted:8221b17d-3386-4e97-a157-ca4c9071392b for instance aaf2b320-c2a2-40d6-afca-73668bda7933 on hv-cinder-82497 Jan 28 02:02:31.429376 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-a9708d09-1a79-4ab3-8e44-174a8472f4ee req-d27568af-ee51-440d-8803-ceb1d2bdfe55 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071237 Jan 28 02:02:31.430012 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 91/188] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:31.435984 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-eacb8753-ce1e-4fed-9d5f-f410a0ce2b9d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:31.444944 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-eacb8753-ce1e-4fed-9d5f-f410a0ce2b9d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.304814 Jan 28 02:02:31.445516 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 98/189] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:31 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:31.516657 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4c170bec-eb5f-445b-9c6c-1820f26c6ed0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:31.517240 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4c170bec-eb5f-445b-9c6c-1820f26c6ed0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:31.523377 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4c170bec-eb5f-445b-9c6c-1820f26c6ed0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.523826 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4c170bec-eb5f-445b-9c6c-1820f26c6ed0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.524611 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4c170bec-eb5f-445b-9c6c-1820f26c6ed0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.525044 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4c170bec-eb5f-445b-9c6c-1820f26c6ed0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.532780 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-cd8ab54a-63e4-44e0-8e5b-7e61f4f042f1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:31.533952 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-cd8ab54a-63e4-44e0-8e5b-7e61f4f042f1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:31.547054 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cd8ab54a-63e4-44e0-8e5b-7e61f4f042f1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.547650 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cd8ab54a-63e4-44e0-8e5b-7e61f4f042f1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.548434 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cd8ab54a-63e4-44e0-8e5b-7e61f4f042f1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.548858 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cd8ab54a-63e4-44e0-8e5b-7e61f4f042f1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.661199 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-4c170bec-eb5f-445b-9c6c-1820f26c6ed0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lazy-loading 'services' on Instance uuid 0c7e70ce-ff2e-4323-baec-1455763bb95f {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:02:31.663264 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-cd8ab54a-63e4-44e0-8e5b-7e61f4f042f1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 19342 microversion: 2.20 time: 0.134781 Jan 28 02:02:31.664245 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 99/190] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:31 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 19342 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:31.756079 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f9ef66d9-7d0a-49c9-b690-1e243fd82769 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:31.756772 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f9ef66d9-7d0a-49c9-b690-1e243fd82769 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:31.763476 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f9ef66d9-7d0a-49c9-b690-1e243fd82769 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.763916 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f9ef66d9-7d0a-49c9-b690-1e243fd82769 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.764679 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f9ef66d9-7d0a-49c9-b690-1e243fd82769 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.765642 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f9ef66d9-7d0a-49c9-b690-1e243fd82769 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.788196 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4c170bec-eb5f-445b-9c6c-1820f26c6ed0 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments/0621f8a4-7210-464b-b1a1-fa81b8290dc4" status: 202 len: 0 microversion: 2.1 time: 0.275659 Jan 28 02:02:31.788993 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 92/191] 10.222.0.77 () {58 vars in 1415 bytes} [Fri Jan 28 02:02:31 2022] DELETE /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments/0621f8a4-7210-464b-b1a1-fa81b8290dc4 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:31.797233 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-00f621b3-f164-4eda-b16e-c85132cc1561 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:31.799170 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-00f621b3-f164-4eda-b16e-c85132cc1561 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:31.818033 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-00f621b3-f164-4eda-b16e-c85132cc1561 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.818479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-00f621b3-f164-4eda-b16e-c85132cc1561 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.819262 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-00f621b3-f164-4eda-b16e-c85132cc1561 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.819701 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-00f621b3-f164-4eda-b16e-c85132cc1561 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.836098 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-f9ef66d9-7d0a-49c9-b690-1e243fd82769 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf94c1b148942939821bdd801d4f907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e903984909674521a44fe37d95d94b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:31.846119 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f9ef66d9-7d0a-49c9-b690-1e243fd82769 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 200 len: 1346 microversion: 2.1 time: 0.093775 Jan 28 02:02:31.850144 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 100/192] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:31 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 1346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:31.855976 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-00f621b3-f164-4eda-b16e-c85132cc1561 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062226 Jan 28 02:02:31.856944 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 93/193] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:02:31 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:32.461235 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4aded3b8-1e29-454c-9f47-9de6dcb0bc27 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:32.461853 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4aded3b8-1e29-454c-9f47-9de6dcb0bc27 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:32.467475 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4aded3b8-1e29-454c-9f47-9de6dcb0bc27 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.468405 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4aded3b8-1e29-454c-9f47-9de6dcb0bc27 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.469273 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4aded3b8-1e29-454c-9f47-9de6dcb0bc27 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.469723 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4aded3b8-1e29-454c-9f47-9de6dcb0bc27 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.599352 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4aded3b8-1e29-454c-9f47-9de6dcb0bc27 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:32.607015 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4aded3b8-1e29-454c-9f47-9de6dcb0bc27 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.149328 Jan 28 02:02:32.607646 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 101/194] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:32 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:32.676952 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1329de91-8404-42aa-9436-339db05de2bc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:32.678492 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1329de91-8404-42aa-9436-339db05de2bc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:32.686366 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1329de91-8404-42aa-9436-339db05de2bc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.687298 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1329de91-8404-42aa-9436-339db05de2bc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.688266 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1329de91-8404-42aa-9436-339db05de2bc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.689024 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1329de91-8404-42aa-9436-339db05de2bc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.820958 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1329de91-8404-42aa-9436-339db05de2bc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 20978 microversion: 2.20 time: 0.147989 Jan 28 02:02:32.821597 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 94/195] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:32 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 20978 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:32.863027 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f7d2552b-5fcc-4591-a8fe-d0d645528a6c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:32.863797 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f7d2552b-5fcc-4591-a8fe-d0d645528a6c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:32.869941 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8d031c71-2d1d-4e4f-a232-32750ec7fb8b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:32.870165 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f7d2552b-5fcc-4591-a8fe-d0d645528a6c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.870613 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f7d2552b-5fcc-4591-a8fe-d0d645528a6c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.871467 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f7d2552b-5fcc-4591-a8fe-d0d645528a6c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.871658 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8d031c71-2d1d-4e4f-a232-32750ec7fb8b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:32.871805 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f7d2552b-5fcc-4591-a8fe-d0d645528a6c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.880658 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d031c71-2d1d-4e4f-a232-32750ec7fb8b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.881039 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d031c71-2d1d-4e4f-a232-32750ec7fb8b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.881892 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d031c71-2d1d-4e4f-a232-32750ec7fb8b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.882332 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d031c71-2d1d-4e4f-a232-32750ec7fb8b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.886733 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-f7d2552b-5fcc-4591-a8fe-d0d645528a6c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] HTTP exception thrown: Instance aaf2b320-c2a2-40d6-afca-73668bda7933 could not be found. Jan 28 02:02:32.887374 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f7d2552b-5fcc-4591-a8fe-d0d645528a6c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Returning 404 to user: Instance aaf2b320-c2a2-40d6-afca-73668bda7933 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:32.888271 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f7d2552b-5fcc-4591-a8fe-d0d645528a6c tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 404 len: 111 microversion: 2.1 time: 0.028940 Jan 28 02:02:32.888863 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 102/196] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:32 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:02:32.923093 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8d031c71-2d1d-4e4f-a232-32750ec7fb8b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058716 Jan 28 02:02:32.923646 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 95/197] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:02:32 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:02:33.001901 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6b5fe326-6c75-4e7b-a431-8c657175d199 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:33.002827 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6b5fe326-6c75-4e7b-a431-8c657175d199 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:33.008989 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b5fe326-6c75-4e7b-a431-8c657175d199 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.009480 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b5fe326-6c75-4e7b-a431-8c657175d199 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.010309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b5fe326-6c75-4e7b-a431-8c657175d199 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.010746 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b5fe326-6c75-4e7b-a431-8c657175d199 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.024633 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-6b5fe326-6c75-4e7b-a431-8c657175d199 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] HTTP exception thrown: Instance aaf2b320-c2a2-40d6-afca-73668bda7933 could not be found. Jan 28 02:02:33.025226 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6b5fe326-6c75-4e7b-a431-8c657175d199 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Returning 404 to user: Instance aaf2b320-c2a2-40d6-afca-73668bda7933 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:33.026107 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6b5fe326-6c75-4e7b-a431-8c657175d199 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027967 Jan 28 02:02:33.026636 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 103/198] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:02:32 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:02:33.625399 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a4806ba0-9760-4bfd-9d4c-638a49227d57 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:33.626175 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a4806ba0-9760-4bfd-9d4c-638a49227d57 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:33.632291 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a4806ba0-9760-4bfd-9d4c-638a49227d57 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.633007 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a4806ba0-9760-4bfd-9d4c-638a49227d57 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.633959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a4806ba0-9760-4bfd-9d4c-638a49227d57 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.634639 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a4806ba0-9760-4bfd-9d4c-638a49227d57 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.757878 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a4806ba0-9760-4bfd-9d4c-638a49227d57 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:33.764991 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a4806ba0-9760-4bfd-9d4c-638a49227d57 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.144330 Jan 28 02:02:33.765544 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 96/199] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:33 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:33.832065 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8e3df812-c2ef-4078-a028-ce970f4094e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:33.832961 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8e3df812-c2ef-4078-a028-ce970f4094e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:33.838676 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8e3df812-c2ef-4078-a028-ce970f4094e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.839113 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8e3df812-c2ef-4078-a028-ce970f4094e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.839855 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8e3df812-c2ef-4078-a028-ce970f4094e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.840277 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8e3df812-c2ef-4078-a028-ce970f4094e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.933966 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-10bef1c3-cf2a-426b-a0a9-f84ffe05cc44 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:33.934864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-10bef1c3-cf2a-426b-a0a9-f84ffe05cc44 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:33.941355 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-10bef1c3-cf2a-426b-a0a9-f84ffe05cc44 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.941826 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-10bef1c3-cf2a-426b-a0a9-f84ffe05cc44 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.942586 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-10bef1c3-cf2a-426b-a0a9-f84ffe05cc44 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.943012 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-10bef1c3-cf2a-426b-a0a9-f84ffe05cc44 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.971270 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-10bef1c3-cf2a-426b-a0a9-f84ffe05cc44 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 Jan 28 02:02:33.971809 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 97/200] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:02:33 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:02:34.780159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-702e02bb-3f42-4f23-b175-f4a2fa2b333e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:34.780762 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-702e02bb-3f42-4f23-b175-f4a2fa2b333e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:34.786488 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-702e02bb-3f42-4f23-b175-f4a2fa2b333e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:34.786937 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-702e02bb-3f42-4f23-b175-f4a2fa2b333e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:34.787704 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-702e02bb-3f42-4f23-b175-f4a2fa2b333e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:34.788136 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-702e02bb-3f42-4f23-b175-f4a2fa2b333e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:34.905115 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-702e02bb-3f42-4f23-b175-f4a2fa2b333e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:34.912342 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-702e02bb-3f42-4f23-b175-f4a2fa2b333e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.135737 Jan 28 02:02:34.912905 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 98/201] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:34 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:34.982193 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-eca0ac72-f13d-47ba-a210-c6ce5bfaa98a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:34.983081 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-eca0ac72-f13d-47ba-a210-c6ce5bfaa98a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:34.989114 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-eca0ac72-f13d-47ba-a210-c6ce5bfaa98a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:34.989549 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-eca0ac72-f13d-47ba-a210-c6ce5bfaa98a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:34.990328 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-eca0ac72-f13d-47ba-a210-c6ce5bfaa98a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:34.990756 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-eca0ac72-f13d-47ba-a210-c6ce5bfaa98a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:35.018684 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-eca0ac72-f13d-47ba-a210-c6ce5bfaa98a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040051 Jan 28 02:02:35.019216 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 99/202] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:02:34 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:02:35.928899 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-53bf72bb-3683-47fa-87ab-5961c382cd2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:35.929490 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-53bf72bb-3683-47fa-87ab-5961c382cd2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:35.935112 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-53bf72bb-3683-47fa-87ab-5961c382cd2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:35.935542 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-53bf72bb-3683-47fa-87ab-5961c382cd2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:35.936295 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-53bf72bb-3683-47fa-87ab-5961c382cd2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:35.936968 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-53bf72bb-3683-47fa-87ab-5961c382cd2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:36.052659 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-53bf72bb-3683-47fa-87ab-5961c382cd2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:36.059760 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-53bf72bb-3683-47fa-87ab-5961c382cd2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.134416 Jan 28 02:02:36.060309 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 100/203] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:35 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:36.065111 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-43045b80-85a5-4847-9913-f8fc87ee033c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:36.066027 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-43045b80-85a5-4847-9913-f8fc87ee033c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:36.071211 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-43045b80-85a5-4847-9913-f8fc87ee033c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:36.071677 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-43045b80-85a5-4847-9913-f8fc87ee033c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:36.072435 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-43045b80-85a5-4847-9913-f8fc87ee033c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:36.072864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-43045b80-85a5-4847-9913-f8fc87ee033c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:36.102290 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-43045b80-85a5-4847-9913-f8fc87ee033c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040996 Jan 28 02:02:36.102836 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 101/204] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:02:36 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:36.178224 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8e3df812-c2ef-4078-a028-ce970f4094e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 24488 microversion: 2.20 time: 2.349508 Jan 28 02:02:36.178851 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 104/205] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:33 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 24488 bytes in 2351 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:37.076331 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-580c373a-bbdc-44c6-9776-d1bc616e2c5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:37.076924 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-580c373a-bbdc-44c6-9776-d1bc616e2c5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:37.082970 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-580c373a-bbdc-44c6-9776-d1bc616e2c5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:37.083319 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-580c373a-bbdc-44c6-9776-d1bc616e2c5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:37.084072 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-580c373a-bbdc-44c6-9776-d1bc616e2c5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:37.084499 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-580c373a-bbdc-44c6-9776-d1bc616e2c5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:37.116612 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4b3d9a32-a0a9-42d6-875b-d2f5a66342a3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:37.118177 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4b3d9a32-a0a9-42d6-875b-d2f5a66342a3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:37.126136 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4b3d9a32-a0a9-42d6-875b-d2f5a66342a3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:37.127333 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4b3d9a32-a0a9-42d6-875b-d2f5a66342a3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:37.130006 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4b3d9a32-a0a9-42d6-875b-d2f5a66342a3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:37.130734 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4b3d9a32-a0a9-42d6-875b-d2f5a66342a3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:37.197027 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4b3d9a32-a0a9-42d6-875b-d2f5a66342a3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086061 Jan 28 02:02:37.201304 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 105/206] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:02:37 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 02:02:37.211308 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e0b449d7-aeaf-4f3b-a365-83f63e88462b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:37.213063 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e0b449d7-aeaf-4f3b-a365-83f63e88462b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:37.228468 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e0b449d7-aeaf-4f3b-a365-83f63e88462b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:37.232026 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e0b449d7-aeaf-4f3b-a365-83f63e88462b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:37.233115 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e0b449d7-aeaf-4f3b-a365-83f63e88462b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:37.234026 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e0b449d7-aeaf-4f3b-a365-83f63e88462b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:37.366957 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-e0b449d7-aeaf-4f3b-a365-83f63e88462b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 25404 microversion: 2.20 time: 0.163818 Jan 28 02:02:37.367579 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 106/207] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:37 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 25404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:37.373048 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1019088735", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "networks": [{"uuid": "a12a014d-4a71-408b-a943-054c73574ed9"}]}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:37.392697 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-580c373a-bbdc-44c6-9776-d1bc616e2c5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:37.401172 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-580c373a-bbdc-44c6-9776-d1bc616e2c5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.328362 Jan 28 02:02:37.401730 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 102/208] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:37 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:37.432318 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.network.neutron [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] validate_networks() for [('a12a014d-4a71-408b-a943-054c73574ed9', None, None, None, None, None)] {{(pid=115760) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:02:37.791272 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Flavor limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:02:37.791841 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Image limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:02:37.792157 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Flavor pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:02:37.792586 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Image pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:02:37.792994 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:02:37.801414 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:37.801889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:37.802695 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:37.803134 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:37.819401 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Getting quotas for project 6639261ee8ee46e0a4e3a01eb63b9ab4. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:02:37.823543 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Getting quotas for user 9717e2ab2be74631aba4b196112bf984 and project 6639261ee8ee46e0a4e3a01eb63b9ab4. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:02:37.835041 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Going to run 1 instances... {{(pid=115760) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:02:37.837485 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:02:37.883558 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9c95a503-533f-457f-863c-b03c9c360814 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514557 Jan 28 02:02:37.884373 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 107/209] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:02:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:02:37.894545 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d41a156e-80da-4e63-b35c-d2bdffc92641 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:37.895151 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d41a156e-80da-4e63-b35c-d2bdffc92641 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:37.955973 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d41a156e-80da-4e63-b35c-d2bdffc92641 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:37.966013 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d41a156e-80da-4e63-b35c-d2bdffc92641 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1218 microversion: 2.1 time: 0.075554 Jan 28 02:02:37.967016 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 103/210] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:37 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:38.381558 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-cf358e04-11cb-4045-91ca-037037ede981 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:38.382555 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-cf358e04-11cb-4045-91ca-037037ede981 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:38.388986 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cf358e04-11cb-4045-91ca-037037ede981 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.389437 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cf358e04-11cb-4045-91ca-037037ede981 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.390237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cf358e04-11cb-4045-91ca-037037ede981 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.390671 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cf358e04-11cb-4045-91ca-037037ede981 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.420620 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0b0150f1-acb9-4c69-9642-b71bca850549 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:38.422306 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0b0150f1-acb9-4c69-9642-b71bca850549 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:38.433082 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0b0150f1-acb9-4c69-9642-b71bca850549 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.433525 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0b0150f1-acb9-4c69-9642-b71bca850549 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.434333 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0b0150f1-acb9-4c69-9642-b71bca850549 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.434760 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0b0150f1-acb9-4c69-9642-b71bca850549 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.556204 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0b0150f1-acb9-4c69-9642-b71bca850549 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:38.563581 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0b0150f1-acb9-4c69-9642-b71bca850549 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.148391 Jan 28 02:02:38.564138 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 104/211] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:38 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:38.568265 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-406fccfd-a216-461c-ad57-cc7370626bac tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:38.568750 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-406fccfd-a216-461c-ad57-cc7370626bac tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:38.574187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-406fccfd-a216-461c-ad57-cc7370626bac tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.574625 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-406fccfd-a216-461c-ad57-cc7370626bac tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.575416 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-406fccfd-a216-461c-ad57-cc7370626bac tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.575847 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-406fccfd-a216-461c-ad57-cc7370626bac tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.588647 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-406fccfd-a216-461c-ad57-cc7370626bac tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] HTTP exception thrown: Instance aaf2b320-c2a2-40d6-afca-73668bda7933 could not be found. Jan 28 02:02:38.589215 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-406fccfd-a216-461c-ad57-cc7370626bac tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Returning 404 to user: Instance aaf2b320-c2a2-40d6-afca-73668bda7933 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:38.590031 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-406fccfd-a216-461c-ad57-cc7370626bac tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "DELETE /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 404 len: 111 microversion: 2.1 time: 0.024986 Jan 28 02:02:38.590561 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 105/212] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:02:38 2022] DELETE /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:02:38.598045 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bac71c4d-9ab5-4463-930a-4cf6701d6b92 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:38.598628 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bac71c4d-9ab5-4463-930a-4cf6701d6b92 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] [instance: aaf2b320-c2a2-40d6-afca-73668bda7933] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:38.603821 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bac71c4d-9ab5-4463-930a-4cf6701d6b92 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.604258 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bac71c4d-9ab5-4463-930a-4cf6701d6b92 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.604999 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bac71c4d-9ab5-4463-930a-4cf6701d6b92 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.605421 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bac71c4d-9ab5-4463-930a-4cf6701d6b92 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.618195 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-bac71c4d-9ab5-4463-930a-4cf6701d6b92 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] HTTP exception thrown: Instance aaf2b320-c2a2-40d6-afca-73668bda7933 could not be found. Jan 28 02:02:38.618752 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bac71c4d-9ab5-4463-930a-4cf6701d6b92 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] Returning 404 to user: Instance aaf2b320-c2a2-40d6-afca-73668bda7933 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:38.619525 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-bac71c4d-9ab5-4463-930a-4cf6701d6b92 tempest-DeleteServersTestJSON-682355776 tempest-DeleteServersTestJSON-682355776-project] 10.222.0.77 "GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933" status: 404 len: 111 microversion: 2.1 time: 0.024669 Jan 28 02:02:38.620015 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 106/213] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:38 2022] GET /compute/v2.1/servers/aaf2b320-c2a2-40d6-afca-73668bda7933 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:02:38.983505 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-346f3e91-d875-41fb-9281-9601d253d893 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:38.984174 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-346f3e91-d875-41fb-9281-9601d253d893 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:38.989863 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-346f3e91-d875-41fb-9281-9601d253d893 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.990306 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-346f3e91-d875-41fb-9281-9601d253d893 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.991091 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-346f3e91-d875-41fb-9281-9601d253d893 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.991518 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-346f3e91-d875-41fb-9281-9601d253d893 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:39.061520 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-346f3e91-d875-41fb-9281-9601d253d893 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:39.070120 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-346f3e91-d875-41fb-9281-9601d253d893 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1214 microversion: 2.1 time: 0.090184 Jan 28 02:02:39.070959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 107/214] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:38 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:39.578866 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3cfdccd6-1ea7-497c-a12c-7c4a11cdd523 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:39.579548 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3cfdccd6-1ea7-497c-a12c-7c4a11cdd523 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:39.585243 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3cfdccd6-1ea7-497c-a12c-7c4a11cdd523 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:39.585686 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3cfdccd6-1ea7-497c-a12c-7c4a11cdd523 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:39.586492 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3cfdccd6-1ea7-497c-a12c-7c4a11cdd523 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:39.586916 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3cfdccd6-1ea7-497c-a12c-7c4a11cdd523 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:39.709058 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3cfdccd6-1ea7-497c-a12c-7c4a11cdd523 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:39.716380 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3cfdccd6-1ea7-497c-a12c-7c4a11cdd523 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.141121 Jan 28 02:02:39.716925 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 108/215] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:39 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:40.087662 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-af5d282f-b522-4af8-bbf3-9876d97cf736 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:40.088266 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-af5d282f-b522-4af8-bbf3-9876d97cf736 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:40.095391 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-af5d282f-b522-4af8-bbf3-9876d97cf736 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:40.095831 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-af5d282f-b522-4af8-bbf3-9876d97cf736 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:40.096603 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-af5d282f-b522-4af8-bbf3-9876d97cf736 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:40.097027 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-af5d282f-b522-4af8-bbf3-9876d97cf736 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:40.154906 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-af5d282f-b522-4af8-bbf3-9876d97cf736 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:40.162808 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-af5d282f-b522-4af8-bbf3-9876d97cf736 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1214 microversion: 2.1 time: 0.078988 Jan 28 02:02:40.163360 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 109/216] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:40 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:40.274337 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2413f2ee-e0b8-4e0f-a717-7a25bb44c48f tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] Action: 'create', calling method: .version_select at 0x7f08d683a550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2020785820", "metadata": {"Type": "work"}}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:40.275771 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2413f2ee-e0b8-4e0f-a717-7a25bb44c48f tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:40.276567 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2413f2ee-e0b8-4e0f-a717-7a25bb44c48f tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.112316 Jan 28 02:02:40.277085 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 110/217] 10.222.0.77 () {60 vars in 1155 bytes} [Fri Jan 28 02:02:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:02:40.285761 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b4a87d40-99f5-462e-bcfd-12ba275427d6 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] Action: 'create', calling method: .version_select at 0x7f08d694a040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-153958194", "metadata": {"Type": "work"}}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:40.286890 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b4a87d40-99f5-462e-bcfd-12ba275427d6 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:40.287649 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b4a87d40-99f5-462e-bcfd-12ba275427d6 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.004995 Jan 28 02:02:40.288146 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 111/218] 10.222.0.77 () {60 vars in 1155 bytes} [Fri Jan 28 02:02:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 28 02:02:40.297512 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e3878afe-1acc-4787-a456-8488b5fffe14 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] Action: 'create', calling method: .version_select at 0x7f08d838daf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-691594087", "metadata": {"Type": "work"}}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:40.298592 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e3878afe-1acc-4787-a456-8488b5fffe14 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:40.299356 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e3878afe-1acc-4787-a456-8488b5fffe14 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007012 Jan 28 02:02:40.299852 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 112/219] 10.222.0.77 () {60 vars in 1155 bytes} [Fri Jan 28 02:02:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 28 02:02:40.307336 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-34791090-a351-4919-850b-9cb3cc173869 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] Calling method '.version_select at 0x7f08d683ad30>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:40.338014 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-34791090-a351-4919-850b-9cb3cc173869 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] HTTP exception thrown: Volume tempest-invalid-1452537872 could not be found. Jan 28 02:02:40.338610 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-34791090-a351-4919-850b-9cb3cc173869 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] Returning 404 to user: Volume tempest-invalid-1452537872 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:40.339436 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-34791090-a351-4919-850b-9cb3cc173869 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1452537872" status: 404 len: 99 microversion: 2.1 time: 0.035144 Jan 28 02:02:40.339972 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 113/220] 10.222.0.77 () {58 vars in 1217 bytes} [Fri Jan 28 02:02:40 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1452537872 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 28 02:02:40.349444 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ae5fa5cd-15ea-4ad1-ad2a-1ce1d22260f3 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003977 Jan 28 02:02:40.349966 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 114/221] 10.222.0.77 () {58 vars in 1139 bytes} [Fri Jan 28 02:02:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 28 02:02:40.357042 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-cd127875-9ba0-4dad-8e6b-8e634a2132a3 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003032 Jan 28 02:02:40.357522 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 115/222] 10.222.0.77 () {58 vars in 1136 bytes} [Fri Jan 28 02:02:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 28 02:02:40.364716 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5e56e46e-bf4a-405a-b83b-6cab94009188 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] Calling method '.version_select at 0x7f08d683a4c0>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:40.391205 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-5e56e46e-bf4a-405a-b83b-6cab94009188 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] HTTP exception thrown: Volume 1f3fc75a-d9e7-4439-a8c5-d7bba6d6089a could not be found. Jan 28 02:02:40.391823 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5e56e46e-bf4a-405a-b83b-6cab94009188 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] Returning 404 to user: Volume 1f3fc75a-d9e7-4439-a8c5-d7bba6d6089a could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:40.392638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-5e56e46e-bf4a-405a-b83b-6cab94009188 tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/1f3fc75a-d9e7-4439-a8c5-d7bba6d6089a" status: 404 len: 109 microversion: 2.1 time: 0.030954 Jan 28 02:02:40.393193 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 116/223] 10.222.0.77 () {58 vars in 1247 bytes} [Fri Jan 28 02:02:40 2022] DELETE /compute/v2.1/os-volumes/1f3fc75a-d9e7-4439-a8c5-d7bba6d6089a => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:02:40.401568 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0a8ce63c-5b45-4d35-bfbc-24f3fa90a1dc tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] Calling method '.version_select at 0x7f08d67efca0>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:40.427382 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-0a8ce63c-5b45-4d35-bfbc-24f3fa90a1dc tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] HTTP exception thrown: Volume e5e528eb-4d4d-4397-b675-466be40f6a08 could not be found. Jan 28 02:02:40.427958 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0a8ce63c-5b45-4d35-bfbc-24f3fa90a1dc tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] Returning 404 to user: Volume e5e528eb-4d4d-4397-b675-466be40f6a08 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:40.428755 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0a8ce63c-5b45-4d35-bfbc-24f3fa90a1dc tempest-VolumesNegativeTest-805779 tempest-VolumesNegativeTest-805779-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/e5e528eb-4d4d-4397-b675-466be40f6a08" status: 404 len: 109 microversion: 2.1 time: 0.030679 Jan 28 02:02:40.429261 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 117/224] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:02:40 2022] GET /compute/v2.1/os-volumes/e5e528eb-4d4d-4397-b675-466be40f6a08 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:02:40.732811 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-302d7127-456a-4012-9a90-ee979352ee0f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:40.733409 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-302d7127-456a-4012-9a90-ee979352ee0f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:40.739213 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-302d7127-456a-4012-9a90-ee979352ee0f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:40.739648 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-302d7127-456a-4012-9a90-ee979352ee0f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:40.740402 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-302d7127-456a-4012-9a90-ee979352ee0f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:40.740824 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-302d7127-456a-4012-9a90-ee979352ee0f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:40.892778 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-302d7127-456a-4012-9a90-ee979352ee0f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:40.900026 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-302d7127-456a-4012-9a90-ee979352ee0f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.170746 Jan 28 02:02:40.900787 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 118/225] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:40 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:41.179132 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e20f6e06-d616-4098-8f2a-3e51a62a3241 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:41.179730 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e20f6e06-d616-4098-8f2a-3e51a62a3241 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:41.185547 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e20f6e06-d616-4098-8f2a-3e51a62a3241 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.186034 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e20f6e06-d616-4098-8f2a-3e51a62a3241 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.187583 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e20f6e06-d616-4098-8f2a-3e51a62a3241 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.188010 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e20f6e06-d616-4098-8f2a-3e51a62a3241 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.248225 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e20f6e06-d616-4098-8f2a-3e51a62a3241 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:41.258393 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e20f6e06-d616-4098-8f2a-3e51a62a3241 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1214 microversion: 2.1 time: 0.082798 Jan 28 02:02:41.259151 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 119/226] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:41 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:41.916099 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-45059367-0e77-427f-8892-9568bf62b00a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:41.916801 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-45059367-0e77-427f-8892-9568bf62b00a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:41.922633 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-45059367-0e77-427f-8892-9568bf62b00a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.923144 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-45059367-0e77-427f-8892-9568bf62b00a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.924024 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-45059367-0e77-427f-8892-9568bf62b00a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.924515 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-45059367-0e77-427f-8892-9568bf62b00a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:42.018026 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-cf358e04-11cb-4045-91ca-037037ede981 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 27630 microversion: 2.20 time: 3.640351 Jan 28 02:02:42.019148 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 108/227] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:38 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 27630 bytes in 3642 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:42.073172 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-45059367-0e77-427f-8892-9568bf62b00a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:42.083051 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-45059367-0e77-427f-8892-9568bf62b00a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.170674 Jan 28 02:02:42.083891 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 120/228] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:41 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:42.277458 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-bc674648-484e-4cc3-8c68-c9cc3bf651ce tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:42.278361 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-bc674648-484e-4cc3-8c68-c9cc3bf651ce tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:42.285091 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bc674648-484e-4cc3-8c68-c9cc3bf651ce tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:42.285533 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bc674648-484e-4cc3-8c68-c9cc3bf651ce tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:42.286325 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bc674648-484e-4cc3-8c68-c9cc3bf651ce tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:42.286749 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bc674648-484e-4cc3-8c68-c9cc3bf651ce tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:42.346337 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bc674648-484e-4cc3-8c68-c9cc3bf651ce tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:42.353437 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-bc674648-484e-4cc3-8c68-c9cc3bf651ce tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1270 microversion: 2.1 time: 0.080398 Jan 28 02:02:42.354040 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 109/229] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:42 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:43.030117 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ff715b1a-0f25-4a5c-aa21-cd5c3af61e00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:43.031706 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ff715b1a-0f25-4a5c-aa21-cd5c3af61e00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:43.037504 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff715b1a-0f25-4a5c-aa21-cd5c3af61e00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:43.037989 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff715b1a-0f25-4a5c-aa21-cd5c3af61e00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:43.038753 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff715b1a-0f25-4a5c-aa21-cd5c3af61e00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:43.039184 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff715b1a-0f25-4a5c-aa21-cd5c3af61e00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:43.106605 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-20bb63dc-f988-4ad8-9215-9daba7ce850d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:43.106605 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-20bb63dc-f988-4ad8-9215-9daba7ce850d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:43.123834 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-20bb63dc-f988-4ad8-9215-9daba7ce850d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:43.124320 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-20bb63dc-f988-4ad8-9215-9daba7ce850d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:43.125716 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-20bb63dc-f988-4ad8-9215-9daba7ce850d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:43.126362 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-20bb63dc-f988-4ad8-9215-9daba7ce850d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:43.165827 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ff715b1a-0f25-4a5c-aa21-cd5c3af61e00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 27955 microversion: 2.20 time: 0.139338 Jan 28 02:02:43.170062 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 121/230] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:43 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 27955 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:43.264200 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-20bb63dc-f988-4ad8-9215-9daba7ce850d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:43.273192 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-20bb63dc-f988-4ad8-9215-9daba7ce850d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.176621 Jan 28 02:02:43.274534 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 110/231] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:43 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:43.370672 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-08c130df-efc3-483f-b33d-436659b20140 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:43.371272 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-08c130df-efc3-483f-b33d-436659b20140 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:43.378413 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-08c130df-efc3-483f-b33d-436659b20140 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:43.379067 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-08c130df-efc3-483f-b33d-436659b20140 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:43.380040 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-08c130df-efc3-483f-b33d-436659b20140 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:43.380438 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-08c130df-efc3-483f-b33d-436659b20140 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:43.451202 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-08c130df-efc3-483f-b33d-436659b20140 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:43.459881 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-08c130df-efc3-483f-b33d-436659b20140 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1276 microversion: 2.1 time: 0.093260 Jan 28 02:02:43.460996 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 122/232] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:43 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:44.180449 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2065b5eb-94a0-407c-8eb8-842c73b5badd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:44.182104 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2065b5eb-94a0-407c-8eb8-842c73b5badd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:44.191584 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2065b5eb-94a0-407c-8eb8-842c73b5badd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.192265 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2065b5eb-94a0-407c-8eb8-842c73b5badd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.193190 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2065b5eb-94a0-407c-8eb8-842c73b5badd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.193788 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2065b5eb-94a0-407c-8eb8-842c73b5badd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.252229 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-8f8286e1-7a33-4577-aaad-6d012ac7f908 req-7c23cf86-dcc3-47a3-9f16-a97879a95fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60cc0a8d-a1cc-413e-ba90-19e9507bcb4e", "tag": "9c389827-57e0-481b-bae4-d3581c28a727"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:44.253904 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:44.253904 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:02:44.260754 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-8f8286e1-7a33-4577-aaad-6d012ac7f908 req-7c23cf86-dcc3-47a3-9f16-a97879a95fbf service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.261192 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-8f8286e1-7a33-4577-aaad-6d012ac7f908 req-7c23cf86-dcc3-47a3-9f16-a97879a95fbf service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.273003 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-8f8286e1-7a33-4577-aaad-6d012ac7f908 req-7c23cf86-dcc3-47a3-9f16-a97879a95fbf service nova] Creating event network-changed:9c389827-57e0-481b-bae4-d3581c28a727 for instance 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e on hv-cinder-82497 Jan 28 02:02:44.278810 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-8f8286e1-7a33-4577-aaad-6d012ac7f908 req-7c23cf86-dcc3-47a3-9f16-a97879a95fbf service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030733 Jan 28 02:02:44.279461 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 123/233] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:02:44.290994 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8fc4b09a-23cd-4bc5-86e1-da1d6d070110 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:44.291675 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8fc4b09a-23cd-4bc5-86e1-da1d6d070110 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:44.298513 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8fc4b09a-23cd-4bc5-86e1-da1d6d070110 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.298947 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8fc4b09a-23cd-4bc5-86e1-da1d6d070110 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.299711 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8fc4b09a-23cd-4bc5-86e1-da1d6d070110 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.300250 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8fc4b09a-23cd-4bc5-86e1-da1d6d070110 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.423358 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8fc4b09a-23cd-4bc5-86e1-da1d6d070110 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:44.430615 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8fc4b09a-23cd-4bc5-86e1-da1d6d070110 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.143446 Jan 28 02:02:44.431110 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 124/234] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:44 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:44.477039 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c97b104b-8ef1-4038-bff6-eb17b2dbeb73 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:44.477637 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c97b104b-8ef1-4038-bff6-eb17b2dbeb73 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:44.484148 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c97b104b-8ef1-4038-bff6-eb17b2dbeb73 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.484600 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c97b104b-8ef1-4038-bff6-eb17b2dbeb73 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.485403 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c97b104b-8ef1-4038-bff6-eb17b2dbeb73 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.485864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c97b104b-8ef1-4038-bff6-eb17b2dbeb73 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.605077 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c97b104b-8ef1-4038-bff6-eb17b2dbeb73 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:44.613300 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c97b104b-8ef1-4038-bff6-eb17b2dbeb73 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.139567 Jan 28 02:02:44.613887 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 125/235] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:44 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:45.447264 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-144e3f6d-d6f1-4364-b1ec-0db836e515f6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:45.447976 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-144e3f6d-d6f1-4364-b1ec-0db836e515f6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:45.453876 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-144e3f6d-d6f1-4364-b1ec-0db836e515f6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:45.454322 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-144e3f6d-d6f1-4364-b1ec-0db836e515f6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:45.455095 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-144e3f6d-d6f1-4364-b1ec-0db836e515f6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:45.455526 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-144e3f6d-d6f1-4364-b1ec-0db836e515f6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:45.574512 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-144e3f6d-d6f1-4364-b1ec-0db836e515f6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:45.581611 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-144e3f6d-d6f1-4364-b1ec-0db836e515f6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.138002 Jan 28 02:02:45.582234 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 126/236] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:45 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:45.630535 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-65bcc9df-b542-403b-8343-4b0d6d420738 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:45.631124 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-65bcc9df-b542-403b-8343-4b0d6d420738 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:45.636662 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-65bcc9df-b542-403b-8343-4b0d6d420738 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:45.637096 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-65bcc9df-b542-403b-8343-4b0d6d420738 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:45.637879 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-65bcc9df-b542-403b-8343-4b0d6d420738 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:45.638304 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-65bcc9df-b542-403b-8343-4b0d6d420738 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:45.753027 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-65bcc9df-b542-403b-8343-4b0d6d420738 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:45.760154 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-65bcc9df-b542-403b-8343-4b0d6d420738 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.133065 Jan 28 02:02:45.760712 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 127/237] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:45 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:46.597881 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-944ece5d-7c92-44f1-8c9b-e910fdcad83b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:46.598507 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-944ece5d-7c92-44f1-8c9b-e910fdcad83b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:46.604404 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-944ece5d-7c92-44f1-8c9b-e910fdcad83b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:46.604850 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-944ece5d-7c92-44f1-8c9b-e910fdcad83b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:46.605622 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-944ece5d-7c92-44f1-8c9b-e910fdcad83b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:46.606152 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-944ece5d-7c92-44f1-8c9b-e910fdcad83b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:46.625524 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2065b5eb-94a0-407c-8eb8-842c73b5badd tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28138 microversion: 2.20 time: 2.450282 Jan 28 02:02:46.626435 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 111/238] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:44 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28138 bytes in 2452 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:46.726033 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-944ece5d-7c92-44f1-8c9b-e910fdcad83b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:46.733277 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-944ece5d-7c92-44f1-8c9b-e910fdcad83b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.139251 Jan 28 02:02:46.733937 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 128/239] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:46 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:46.776644 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c97a20e7-4150-4041-b769-7fbe7d601ace tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:46.777325 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c97a20e7-4150-4041-b769-7fbe7d601ace tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:46.783649 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c97a20e7-4150-4041-b769-7fbe7d601ace tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:46.784007 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c97a20e7-4150-4041-b769-7fbe7d601ace tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:46.784757 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c97a20e7-4150-4041-b769-7fbe7d601ace tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:46.785180 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c97a20e7-4150-4041-b769-7fbe7d601ace tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:46.921494 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c97a20e7-4150-4041-b769-7fbe7d601ace tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:46.929456 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c97a20e7-4150-4041-b769-7fbe7d601ace tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.156723 Jan 28 02:02:46.930072 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 112/240] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:46 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:47.636968 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-08adf10e-0b7d-4bfc-87ee-455493878d46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:47.637908 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-08adf10e-0b7d-4bfc-87ee-455493878d46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:47.646291 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-08adf10e-0b7d-4bfc-87ee-455493878d46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:47.646735 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-08adf10e-0b7d-4bfc-87ee-455493878d46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:47.647546 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-08adf10e-0b7d-4bfc-87ee-455493878d46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:47.647991 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-08adf10e-0b7d-4bfc-87ee-455493878d46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:47.751149 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-52f3c6e7-dbb8-4eda-b43d-59c19a45ac6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:47.751965 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-52f3c6e7-dbb8-4eda-b43d-59c19a45ac6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:47.758105 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-52f3c6e7-dbb8-4eda-b43d-59c19a45ac6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:47.758551 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-52f3c6e7-dbb8-4eda-b43d-59c19a45ac6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:47.759419 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-52f3c6e7-dbb8-4eda-b43d-59c19a45ac6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:47.759872 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-52f3c6e7-dbb8-4eda-b43d-59c19a45ac6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:47.770902 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-08adf10e-0b7d-4bfc-87ee-455493878d46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28138 microversion: 2.20 time: 0.137918 Jan 28 02:02:47.774896 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 129/241] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:47 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28138 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:47.878299 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-52f3c6e7-dbb8-4eda-b43d-59c19a45ac6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:47.885418 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-52f3c6e7-dbb8-4eda-b43d-59c19a45ac6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.139460 Jan 28 02:02:47.886010 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 113/242] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:47 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:47.947256 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0ab4bd12-c5ab-47ff-acdf-f74ce4c87dd6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:47.947946 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0ab4bd12-c5ab-47ff-acdf-f74ce4c87dd6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:47.954412 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ab4bd12-c5ab-47ff-acdf-f74ce4c87dd6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:47.954855 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ab4bd12-c5ab-47ff-acdf-f74ce4c87dd6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:47.955616 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ab4bd12-c5ab-47ff-acdf-f74ce4c87dd6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:47.956047 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ab4bd12-c5ab-47ff-acdf-f74ce4c87dd6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:48.073524 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0ab4bd12-c5ab-47ff-acdf-f74ce4c87dd6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:48.080838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0ab4bd12-c5ab-47ff-acdf-f74ce4c87dd6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.137552 Jan 28 02:02:48.081508 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 130/243] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:47 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:48.782965 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ab0322d6-d779-4eb0-ad36-c71c12637f4f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:48.783871 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ab0322d6-d779-4eb0-ad36-c71c12637f4f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:48.789470 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ab0322d6-d779-4eb0-ad36-c71c12637f4f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:48.789960 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ab0322d6-d779-4eb0-ad36-c71c12637f4f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:48.790750 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ab0322d6-d779-4eb0-ad36-c71c12637f4f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:48.791178 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ab0322d6-d779-4eb0-ad36-c71c12637f4f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:48.902087 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-665e2780-3991-4660-a195-1fb96ed0f2c2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:48.902601 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-665e2780-3991-4660-a195-1fb96ed0f2c2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:48.909309 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-665e2780-3991-4660-a195-1fb96ed0f2c2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:48.909859 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-665e2780-3991-4660-a195-1fb96ed0f2c2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:48.910714 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-665e2780-3991-4660-a195-1fb96ed0f2c2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:48.911154 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-665e2780-3991-4660-a195-1fb96ed0f2c2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:49.027835 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-665e2780-3991-4660-a195-1fb96ed0f2c2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:49.035741 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-665e2780-3991-4660-a195-1fb96ed0f2c2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.137383 Jan 28 02:02:49.036299 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 131/244] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:48 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:49.097802 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8530e986-5b88-484d-9835-d5306c1e274b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:49.098552 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8530e986-5b88-484d-9835-d5306c1e274b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:49.104652 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8530e986-5b88-484d-9835-d5306c1e274b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:49.105015 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8530e986-5b88-484d-9835-d5306c1e274b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:49.105793 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8530e986-5b88-484d-9835-d5306c1e274b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:49.106229 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8530e986-5b88-484d-9835-d5306c1e274b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:49.229204 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8530e986-5b88-484d-9835-d5306c1e274b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:49.236539 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8530e986-5b88-484d-9835-d5306c1e274b tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.142427 Jan 28 02:02:49.237093 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 132/245] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:49 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:50.052588 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-915e81ed-6707-4c3b-a1c6-4e8a4dfa2aa4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:50.053187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-915e81ed-6707-4c3b-a1c6-4e8a4dfa2aa4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:50.059064 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-915e81ed-6707-4c3b-a1c6-4e8a4dfa2aa4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:50.059512 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-915e81ed-6707-4c3b-a1c6-4e8a4dfa2aa4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:50.060447 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-915e81ed-6707-4c3b-a1c6-4e8a4dfa2aa4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:50.060882 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-915e81ed-6707-4c3b-a1c6-4e8a4dfa2aa4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:50.190632 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-915e81ed-6707-4c3b-a1c6-4e8a4dfa2aa4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:50.197915 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-915e81ed-6707-4c3b-a1c6-4e8a4dfa2aa4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.148878 Jan 28 02:02:50.198486 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 133/246] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:50 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:50.253174 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6f3723ab-e2a7-4c33-9b4d-0de80a6eeaec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:50.254180 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6f3723ab-e2a7-4c33-9b4d-0de80a6eeaec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:50.261066 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6f3723ab-e2a7-4c33-9b4d-0de80a6eeaec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:50.261697 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6f3723ab-e2a7-4c33-9b4d-0de80a6eeaec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:50.262492 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6f3723ab-e2a7-4c33-9b4d-0de80a6eeaec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:50.262948 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6f3723ab-e2a7-4c33-9b4d-0de80a6eeaec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:50.388960 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6f3723ab-e2a7-4c33-9b4d-0de80a6eeaec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:50.396219 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6f3723ab-e2a7-4c33-9b4d-0de80a6eeaec tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.147725 Jan 28 02:02:50.396787 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 134/247] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:50 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:50.860757 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ab0322d6-d779-4eb0-ad36-c71c12637f4f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28138 microversion: 2.20 time: 2.081718 Jan 28 02:02:50.861394 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 114/248] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:48 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28138 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:51.214393 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7282d1d8-8a70-4dbd-93aa-238350671ece tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:51.214974 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7282d1d8-8a70-4dbd-93aa-238350671ece tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:51.221099 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7282d1d8-8a70-4dbd-93aa-238350671ece tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:51.221535 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7282d1d8-8a70-4dbd-93aa-238350671ece tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:51.222322 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7282d1d8-8a70-4dbd-93aa-238350671ece tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:51.222745 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7282d1d8-8a70-4dbd-93aa-238350671ece tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:51.343133 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7282d1d8-8a70-4dbd-93aa-238350671ece tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:51.350314 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7282d1d8-8a70-4dbd-93aa-238350671ece tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.139670 Jan 28 02:02:51.350870 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 135/249] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:51 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:51.413037 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-32032634-6173-4eb6-b0aa-4c485c5310aa tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:51.413716 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-32032634-6173-4eb6-b0aa-4c485c5310aa tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:51.420082 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-32032634-6173-4eb6-b0aa-4c485c5310aa tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:51.420515 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-32032634-6173-4eb6-b0aa-4c485c5310aa tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:51.421793 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-32032634-6173-4eb6-b0aa-4c485c5310aa tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:51.422222 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-32032634-6173-4eb6-b0aa-4c485c5310aa tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:51.543055 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-32032634-6173-4eb6-b0aa-4c485c5310aa tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:51.550619 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-32032634-6173-4eb6-b0aa-4c485c5310aa tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.141685 Jan 28 02:02:51.551166 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 115/250] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:51 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:51.872948 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-10183f3f-9950-4972-aec0-ce503dffbe1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:51.874064 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-10183f3f-9950-4972-aec0-ce503dffbe1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:51.880155 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-10183f3f-9950-4972-aec0-ce503dffbe1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:51.880701 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-10183f3f-9950-4972-aec0-ce503dffbe1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:51.881577 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-10183f3f-9950-4972-aec0-ce503dffbe1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:51.882144 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-10183f3f-9950-4972-aec0-ce503dffbe1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:52.366554 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-21ba51ff-42b3-4aca-92ae-ee6c7532fc43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:52.367228 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-21ba51ff-42b3-4aca-92ae-ee6c7532fc43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:52.372962 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-21ba51ff-42b3-4aca-92ae-ee6c7532fc43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:52.373439 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-21ba51ff-42b3-4aca-92ae-ee6c7532fc43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:52.374346 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-21ba51ff-42b3-4aca-92ae-ee6c7532fc43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:52.374904 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-21ba51ff-42b3-4aca-92ae-ee6c7532fc43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:52.493011 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-21ba51ff-42b3-4aca-92ae-ee6c7532fc43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:52.501060 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-21ba51ff-42b3-4aca-92ae-ee6c7532fc43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.138080 Jan 28 02:02:52.501796 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 116/251] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:52 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:52.567767 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7fdd459e-c642-4671-bdc0-4624e04203ad tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:52.568370 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7fdd459e-c642-4671-bdc0-4624e04203ad tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:52.574195 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7fdd459e-c642-4671-bdc0-4624e04203ad tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:52.574640 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7fdd459e-c642-4671-bdc0-4624e04203ad tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:52.575395 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7fdd459e-c642-4671-bdc0-4624e04203ad tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:52.575823 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7fdd459e-c642-4671-bdc0-4624e04203ad tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:52.694969 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7fdd459e-c642-4671-bdc0-4624e04203ad tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:52.702958 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7fdd459e-c642-4671-bdc0-4624e04203ad tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.137851 Jan 28 02:02:52.703513 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 117/252] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:52 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:53.517771 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-88ca29f6-b885-435c-86b8-be96b05d0f9c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:53.518398 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-88ca29f6-b885-435c-86b8-be96b05d0f9c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:53.524898 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-88ca29f6-b885-435c-86b8-be96b05d0f9c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:53.525328 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-88ca29f6-b885-435c-86b8-be96b05d0f9c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:53.526261 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-88ca29f6-b885-435c-86b8-be96b05d0f9c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:53.526965 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-88ca29f6-b885-435c-86b8-be96b05d0f9c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:53.654677 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-88ca29f6-b885-435c-86b8-be96b05d0f9c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:53.662516 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-88ca29f6-b885-435c-86b8-be96b05d0f9c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.148251 Jan 28 02:02:53.662910 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 118/253] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:53 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:53.718894 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6bb5d498-fffc-4355-8168-a25ab9276399 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:53.719497 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6bb5d498-fffc-4355-8168-a25ab9276399 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:53.725154 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6bb5d498-fffc-4355-8168-a25ab9276399 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:53.725597 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6bb5d498-fffc-4355-8168-a25ab9276399 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:53.726403 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6bb5d498-fffc-4355-8168-a25ab9276399 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:53.726829 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6bb5d498-fffc-4355-8168-a25ab9276399 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:53.841552 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6bb5d498-fffc-4355-8168-a25ab9276399 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:53.849248 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6bb5d498-fffc-4355-8168-a25ab9276399 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.134474 Jan 28 02:02:53.849818 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 119/254] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:53 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:54.357571 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-10183f3f-9950-4972-aec0-ce503dffbe1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28138 microversion: 2.20 time: 2.488559 Jan 28 02:02:54.361628 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 136/255] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:51 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28138 bytes in 2490 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:54.679989 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9afe4792-ae47-418d-9435-485a132dbd70 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:54.680575 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9afe4792-ae47-418d-9435-485a132dbd70 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:54.688212 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9afe4792-ae47-418d-9435-485a132dbd70 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:54.688652 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9afe4792-ae47-418d-9435-485a132dbd70 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:54.689420 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9afe4792-ae47-418d-9435-485a132dbd70 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:54.689929 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9afe4792-ae47-418d-9435-485a132dbd70 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:54.810571 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9afe4792-ae47-418d-9435-485a132dbd70 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:54.817967 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9afe4792-ae47-418d-9435-485a132dbd70 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.142845 Jan 28 02:02:54.818518 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 120/256] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:54 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:54.866980 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f96544ca-1517-49f4-abbf-2ca7e39df76a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:54.867681 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f96544ca-1517-49f4-abbf-2ca7e39df76a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:54.874320 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f96544ca-1517-49f4-abbf-2ca7e39df76a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:54.874759 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f96544ca-1517-49f4-abbf-2ca7e39df76a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:54.875522 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f96544ca-1517-49f4-abbf-2ca7e39df76a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:54.875943 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f96544ca-1517-49f4-abbf-2ca7e39df76a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:55.000943 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f96544ca-1517-49f4-abbf-2ca7e39df76a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:55.008892 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f96544ca-1517-49f4-abbf-2ca7e39df76a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.146345 Jan 28 02:02:55.009589 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 137/257] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:54 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:55.369346 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1a85d9fc-0714-4f41-86ea-46ace69ab637 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:55.370297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1a85d9fc-0714-4f41-86ea-46ace69ab637 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:55.378502 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1a85d9fc-0714-4f41-86ea-46ace69ab637 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:55.379147 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1a85d9fc-0714-4f41-86ea-46ace69ab637 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:55.381089 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1a85d9fc-0714-4f41-86ea-46ace69ab637 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:55.381692 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1a85d9fc-0714-4f41-86ea-46ace69ab637 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:55.568013 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1a85d9fc-0714-4f41-86ea-46ace69ab637 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28218 microversion: 2.20 time: 0.202589 Jan 28 02:02:55.571464 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 121/258] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:55 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:55.834423 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4d8995de-6460-45d4-a6b1-5dd30437b4bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:55.835024 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4d8995de-6460-45d4-a6b1-5dd30437b4bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:55.840709 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4d8995de-6460-45d4-a6b1-5dd30437b4bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:55.841148 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4d8995de-6460-45d4-a6b1-5dd30437b4bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:55.841938 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4d8995de-6460-45d4-a6b1-5dd30437b4bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:55.842365 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4d8995de-6460-45d4-a6b1-5dd30437b4bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:55.893186 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-566377319", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "networks": [{"uuid": "03f0791d-b3f7-4442-a4cf-e0612c275e41"}]}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:55.948426 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.network.neutron [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] validate_networks() for [('03f0791d-b3f7-4442-a4cf-e0612c275e41', None, None, None, None, None)] {{(pid=115760) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:02:55.993207 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4d8995de-6460-45d4-a6b1-5dd30437b4bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:56.001037 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4d8995de-6460-45d4-a6b1-5dd30437b4bc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.170108 Jan 28 02:02:56.001617 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 138/259] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:55 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:56.024578 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-285764c3-701e-468d-b3e0-0d17f12ee74e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:56.025172 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-285764c3-701e-468d-b3e0-0d17f12ee74e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:56.031605 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-285764c3-701e-468d-b3e0-0d17f12ee74e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:56.031979 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-285764c3-701e-468d-b3e0-0d17f12ee74e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:56.032737 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-285764c3-701e-468d-b3e0-0d17f12ee74e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:56.033159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-285764c3-701e-468d-b3e0-0d17f12ee74e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:56.462248 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-285764c3-701e-468d-b3e0-0d17f12ee74e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:56.469433 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-285764c3-701e-468d-b3e0-0d17f12ee74e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.448460 Jan 28 02:02:56.470022 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 139/260] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:56 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:56.570587 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Flavor limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:02:56.571000 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Image limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:02:56.571548 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Flavor pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:02:56.571975 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Image pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:02:56.572411 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:02:56.580986 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a7e99f41-a5a2-4672-bd0b-71cf7cde0bf4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:56.582016 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a7e99f41-a5a2-4672-bd0b-71cf7cde0bf4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:56.590606 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7e99f41-a5a2-4672-bd0b-71cf7cde0bf4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:56.591047 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7e99f41-a5a2-4672-bd0b-71cf7cde0bf4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:56.591376 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:56.591812 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:56.591937 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7e99f41-a5a2-4672-bd0b-71cf7cde0bf4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:56.592242 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7e99f41-a5a2-4672-bd0b-71cf7cde0bf4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:56.592598 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:56.593020 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:56.608341 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Getting quotas for project db6ea7ebf03d4ba89b2158cb1610b391. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:02:56.612103 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Getting quotas for user 1f85e8545e634ff99938a4c9dfa1bd2c and project db6ea7ebf03d4ba89b2158cb1610b391. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:02:56.628953 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Going to run 1 instances... {{(pid=115760) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:02:56.631367 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:02:56.677213 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-89b0e3e9-99df-49e8-9487-a51eddd21349 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787994 Jan 28 02:02:56.678355 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 122/261] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:02:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 02:02:56.688149 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-40159a6e-5202-4c20-abab-12c84254f405 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:56.688740 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-40159a6e-5202-4c20-abab-12c84254f405 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:56.751547 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-40159a6e-5202-4c20-abab-12c84254f405 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:56.758057 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-40159a6e-5202-4c20-abab-12c84254f405 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1213 microversion: 2.1 time: 0.074206 Jan 28 02:02:56.758600 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 123/262] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:56 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:57.017644 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6aa524ae-0c65-493f-a5d1-a843da030e8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:57.018279 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6aa524ae-0c65-493f-a5d1-a843da030e8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:57.025193 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6aa524ae-0c65-493f-a5d1-a843da030e8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:57.025638 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6aa524ae-0c65-493f-a5d1-a843da030e8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:57.026766 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6aa524ae-0c65-493f-a5d1-a843da030e8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:57.026882 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6aa524ae-0c65-493f-a5d1-a843da030e8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:57.146262 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6aa524ae-0c65-493f-a5d1-a843da030e8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:57.153567 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6aa524ae-0c65-493f-a5d1-a843da030e8a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.140404 Jan 28 02:02:57.154199 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 124/263] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:57 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:57.485334 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-dd5c1afb-096d-4218-9dd5-d19c8debf677 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:57.485971 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-dd5c1afb-096d-4218-9dd5-d19c8debf677 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:57.491680 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dd5c1afb-096d-4218-9dd5-d19c8debf677 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:57.492119 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dd5c1afb-096d-4218-9dd5-d19c8debf677 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:57.492876 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dd5c1afb-096d-4218-9dd5-d19c8debf677 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:57.493300 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dd5c1afb-096d-4218-9dd5-d19c8debf677 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:57.619150 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-dd5c1afb-096d-4218-9dd5-d19c8debf677 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:57.630262 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-dd5c1afb-096d-4218-9dd5-d19c8debf677 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.148814 Jan 28 02:02:57.630842 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 125/264] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:57 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:57.775849 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8e8c230d-bdc2-4a26-a816-c84bfb32847d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:57.776502 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8e8c230d-bdc2-4a26-a816-c84bfb32847d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:57.782659 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8e8c230d-bdc2-4a26-a816-c84bfb32847d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:57.783098 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8e8c230d-bdc2-4a26-a816-c84bfb32847d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:57.783862 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8e8c230d-bdc2-4a26-a816-c84bfb32847d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:57.784288 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8e8c230d-bdc2-4a26-a816-c84bfb32847d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:57.850828 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8e8c230d-bdc2-4a26-a816-c84bfb32847d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:57.865245 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8e8c230d-bdc2-4a26-a816-c84bfb32847d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1217 microversion: 2.1 time: 0.092960 Jan 28 02:02:57.865836 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 126/265] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:57 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:58.171552 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-03bef962-31c2-41fa-b677-e17116a85fb8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:58.172190 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-03bef962-31c2-41fa-b677-e17116a85fb8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:58.178194 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-03bef962-31c2-41fa-b677-e17116a85fb8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:58.178636 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-03bef962-31c2-41fa-b677-e17116a85fb8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:58.179402 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-03bef962-31c2-41fa-b677-e17116a85fb8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:58.179827 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-03bef962-31c2-41fa-b677-e17116a85fb8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:58.318991 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-03bef962-31c2-41fa-b677-e17116a85fb8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:58.328183 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-03bef962-31c2-41fa-b677-e17116a85fb8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.161048 Jan 28 02:02:58.328782 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 127/266] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:58 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:58.649022 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-33e85f04-45c2-476a-bc1b-ac6fd3efbc9a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:58.649812 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-33e85f04-45c2-476a-bc1b-ac6fd3efbc9a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:58.656201 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-33e85f04-45c2-476a-bc1b-ac6fd3efbc9a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:58.656642 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-33e85f04-45c2-476a-bc1b-ac6fd3efbc9a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:58.657402 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-33e85f04-45c2-476a-bc1b-ac6fd3efbc9a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:58.657855 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-33e85f04-45c2-476a-bc1b-ac6fd3efbc9a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:58.789052 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-33e85f04-45c2-476a-bc1b-ac6fd3efbc9a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:58.796199 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-33e85f04-45c2-476a-bc1b-ac6fd3efbc9a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.151750 Jan 28 02:02:58.796746 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 128/267] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:58 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:58.882750 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4e498f65-3e8b-499a-9854-6f27bf55003f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:58.883354 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4e498f65-3e8b-499a-9854-6f27bf55003f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:58.890447 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4e498f65-3e8b-499a-9854-6f27bf55003f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:58.890897 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4e498f65-3e8b-499a-9854-6f27bf55003f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:58.891690 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4e498f65-3e8b-499a-9854-6f27bf55003f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:58.892128 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4e498f65-3e8b-499a-9854-6f27bf55003f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:58.969711 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4e498f65-3e8b-499a-9854-6f27bf55003f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:58.976794 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4e498f65-3e8b-499a-9854-6f27bf55003f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1217 microversion: 2.1 time: 0.098539 Jan 28 02:02:58.977541 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 129/268] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:58 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:59.004817 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a7e99f41-a5a2-4672-bd0b-71cf7cde0bf4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28429 microversion: 2.20 time: 2.428402 Jan 28 02:02:59.005609 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 140/269] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:56 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28429 bytes in 2430 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:59.347301 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-27f01233-23b5-4a85-81e5-b7617dad4410 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:59.347902 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-27f01233-23b5-4a85-81e5-b7617dad4410 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:59.354112 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-27f01233-23b5-4a85-81e5-b7617dad4410 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:59.354558 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-27f01233-23b5-4a85-81e5-b7617dad4410 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:59.355351 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-27f01233-23b5-4a85-81e5-b7617dad4410 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:59.355784 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-27f01233-23b5-4a85-81e5-b7617dad4410 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:59.479104 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-27f01233-23b5-4a85-81e5-b7617dad4410 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:59.486862 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-27f01233-23b5-4a85-81e5-b7617dad4410 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1522 microversion: 2.1 time: 0.143227 Jan 28 02:02:59.487457 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 130/270] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:59 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:59.813785 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-494d9dde-0a01-4327-93d6-d6304a9a4c0d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:59.815210 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-494d9dde-0a01-4327-93d6-d6304a9a4c0d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:59.822261 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-494d9dde-0a01-4327-93d6-d6304a9a4c0d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:59.822704 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-494d9dde-0a01-4327-93d6-d6304a9a4c0d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:59.823483 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-494d9dde-0a01-4327-93d6-d6304a9a4c0d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:59.823913 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-494d9dde-0a01-4327-93d6-d6304a9a4c0d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:59.994669 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-28815387-2a5b-473f-a804-c18b9a5935fb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:59.997079 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-28815387-2a5b-473f-a804-c18b9a5935fb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:00.003558 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-494d9dde-0a01-4327-93d6-d6304a9a4c0d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:00.008241 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-28815387-2a5b-473f-a804-c18b9a5935fb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.008976 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-28815387-2a5b-473f-a804-c18b9a5935fb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:00.010145 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-28815387-2a5b-473f-a804-c18b9a5935fb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.010903 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-28815387-2a5b-473f-a804-c18b9a5935fb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:00.015616 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-494d9dde-0a01-4327-93d6-d6304a9a4c0d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.206044 Jan 28 02:03:00.017733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 141/271] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:59 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:00.024424 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a8ad0e81-6935-404b-9e8b-7ef38d1d026e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:00.026410 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a8ad0e81-6935-404b-9e8b-7ef38d1d026e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:00.034234 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a8ad0e81-6935-404b-9e8b-7ef38d1d026e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.035165 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a8ad0e81-6935-404b-9e8b-7ef38d1d026e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:00.036589 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a8ad0e81-6935-404b-9e8b-7ef38d1d026e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.037468 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a8ad0e81-6935-404b-9e8b-7ef38d1d026e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:00.134584 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-28815387-2a5b-473f-a804-c18b9a5935fb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:00.143081 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-28815387-2a5b-473f-a804-c18b9a5935fb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1283 microversion: 2.1 time: 0.152667 Jan 28 02:03:00.143908 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 131/272] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:59 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:00.190532 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a8ad0e81-6935-404b-9e8b-7ef38d1d026e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28429 microversion: 2.20 time: 0.171217 Jan 28 02:03:00.192573 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 142/273] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:00 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:00.507795 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-f32ba1d0-8d1e-4720-a055-be462822d719 req-6207db6d-1d45-4117-9880-b84c7e35f465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60cc0a8d-a1cc-413e-ba90-19e9507bcb4e", "name": "network-vif-plugged", "status": "completed", "tag": "9c389827-57e0-481b-bae4-d3581c28a727"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:00.510017 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-fa5048f7-3e43-4167-8385-595fc0c955cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:00.512308 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:00.512308 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:03:00.513436 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-fa5048f7-3e43-4167-8385-595fc0c955cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:00.527324 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fa5048f7-3e43-4167-8385-595fc0c955cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.530020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-f32ba1d0-8d1e-4720-a055-be462822d719 req-6207db6d-1d45-4117-9880-b84c7e35f465 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.530396 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fa5048f7-3e43-4167-8385-595fc0c955cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:00.531268 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fa5048f7-3e43-4167-8385-595fc0c955cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.531699 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fa5048f7-3e43-4167-8385-595fc0c955cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:00.536763 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-f32ba1d0-8d1e-4720-a055-be462822d719 req-6207db6d-1d45-4117-9880-b84c7e35f465 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:00.551843 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-f32ba1d0-8d1e-4720-a055-be462822d719 req-6207db6d-1d45-4117-9880-b84c7e35f465 service nova] Creating event network-vif-plugged:9c389827-57e0-481b-bae4-d3581c28a727 for instance 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e on hv-cinder-82497 Jan 28 02:03:00.566391 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-f32ba1d0-8d1e-4720-a055-be462822d719 req-6207db6d-1d45-4117-9880-b84c7e35f465 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062360 Jan 28 02:03:00.567072 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 143/274] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:00.684913 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-fa5048f7-3e43-4167-8385-595fc0c955cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:00.699383 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-fa5048f7-3e43-4167-8385-595fc0c955cc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1502 microversion: 2.1 time: 0.199018 Jan 28 02:03:00.703265 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 132/275] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:00 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:00.719548 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6c9868fa-4ba1-4b26-96b6-43ae0428ac83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:00.720626 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6c9868fa-4ba1-4b26-96b6-43ae0428ac83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:00.728954 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6c9868fa-4ba1-4b26-96b6-43ae0428ac83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.729787 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6c9868fa-4ba1-4b26-96b6-43ae0428ac83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:00.730923 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6c9868fa-4ba1-4b26-96b6-43ae0428ac83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.731356 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6c9868fa-4ba1-4b26-96b6-43ae0428ac83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:00.939216 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6c9868fa-4ba1-4b26-96b6-43ae0428ac83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:00.949048 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6c9868fa-4ba1-4b26-96b6-43ae0428ac83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1515 microversion: 2.1 time: 0.233926 Jan 28 02:03:00.950468 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 144/276] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:00 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:01.038111 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e07dd0e7-68c4-4f81-94f5-5ab72e1acd0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:01.039971 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e07dd0e7-68c4-4f81-94f5-5ab72e1acd0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:01.050629 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e07dd0e7-68c4-4f81-94f5-5ab72e1acd0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:01.051449 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e07dd0e7-68c4-4f81-94f5-5ab72e1acd0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:01.053693 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e07dd0e7-68c4-4f81-94f5-5ab72e1acd0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:01.054167 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e07dd0e7-68c4-4f81-94f5-5ab72e1acd0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:01.161784 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ae9f73b0-10e5-4c48-a5a1-adf7a5a28b3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:01.163281 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ae9f73b0-10e5-4c48-a5a1-adf7a5a28b3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:01.179262 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ae9f73b0-10e5-4c48-a5a1-adf7a5a28b3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:01.180040 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ae9f73b0-10e5-4c48-a5a1-adf7a5a28b3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:01.181077 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ae9f73b0-10e5-4c48-a5a1-adf7a5a28b3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:01.181513 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ae9f73b0-10e5-4c48-a5a1-adf7a5a28b3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:01.219734 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-e07dd0e7-68c4-4f81-94f5-5ab72e1acd0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:01.228004 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-e07dd0e7-68c4-4f81-94f5-5ab72e1acd0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.197989 Jan 28 02:03:01.237958 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 133/277] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:01 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:01.243223 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e376cd80-7e07-43a7-a8b7-164e994502c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:01.244454 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e376cd80-7e07-43a7-a8b7-164e994502c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:01.251711 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e376cd80-7e07-43a7-a8b7-164e994502c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:01.252399 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e376cd80-7e07-43a7-a8b7-164e994502c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:01.253412 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e376cd80-7e07-43a7-a8b7-164e994502c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:01.254022 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e376cd80-7e07-43a7-a8b7-164e994502c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:01.399511 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ae9f73b0-10e5-4c48-a5a1-adf7a5a28b3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:01.408015 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ae9f73b0-10e5-4c48-a5a1-adf7a5a28b3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.250690 Jan 28 02:03:01.417645 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 145/278] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:01 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:01.428536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-e376cd80-7e07-43a7-a8b7-164e994502c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28597 microversion: 2.20 time: 0.188659 Jan 28 02:03:01.429248 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 134/279] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:01 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28597 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:01.567291 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-b06e8bed-dc05-43f9-a8d6-4b928f7e5486 req-5925211c-cb02-4b9f-a7e6-2bf3c3bc90f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb6e346f-7608-43e4-a218-aaef2e657f0f", "tag": "74f004ac-1a79-4bd1-be0e-04fb236b29f4"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:01.569053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:01.569053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:03:01.579311 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-b06e8bed-dc05-43f9-a8d6-4b928f7e5486 req-5925211c-cb02-4b9f-a7e6-2bf3c3bc90f1 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:01.579770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-b06e8bed-dc05-43f9-a8d6-4b928f7e5486 req-5925211c-cb02-4b9f-a7e6-2bf3c3bc90f1 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:01.600573 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-b06e8bed-dc05-43f9-a8d6-4b928f7e5486 req-5925211c-cb02-4b9f-a7e6-2bf3c3bc90f1 service nova] Creating event network-changed:74f004ac-1a79-4bd1-be0e-04fb236b29f4 for instance cb6e346f-7608-43e4-a218-aaef2e657f0f on hv-cinder-82497 Jan 28 02:03:01.605415 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-b06e8bed-dc05-43f9-a8d6-4b928f7e5486 req-5925211c-cb02-4b9f-a7e6-2bf3c3bc90f1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041998 Jan 28 02:03:01.606032 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 146/280] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:02.255377 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4095ed9a-780a-4aac-b038-ec4131034d12 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:02.256948 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4095ed9a-780a-4aac-b038-ec4131034d12 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:02.264606 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4095ed9a-780a-4aac-b038-ec4131034d12 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.265288 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4095ed9a-780a-4aac-b038-ec4131034d12 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.266186 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4095ed9a-780a-4aac-b038-ec4131034d12 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.266729 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4095ed9a-780a-4aac-b038-ec4131034d12 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.406449 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4095ed9a-780a-4aac-b038-ec4131034d12 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:02.414385 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4095ed9a-780a-4aac-b038-ec4131034d12 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1318 microversion: 2.1 time: 0.163151 Jan 28 02:03:02.424794 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 135/281] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:02 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:02.428499 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0982d9e6-68f2-4460-876d-3bc23a35b8e4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:02.429719 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0982d9e6-68f2-4460-876d-3bc23a35b8e4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:02.441534 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a3e123f1-b689-4715-804d-c34100c6c549 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:02.442612 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a3e123f1-b689-4715-804d-c34100c6c549 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:02.444278 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0982d9e6-68f2-4460-876d-3bc23a35b8e4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.446284 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0982d9e6-68f2-4460-876d-3bc23a35b8e4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.447103 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0982d9e6-68f2-4460-876d-3bc23a35b8e4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.447541 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0982d9e6-68f2-4460-876d-3bc23a35b8e4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.454766 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a3e123f1-b689-4715-804d-c34100c6c549 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.455237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a3e123f1-b689-4715-804d-c34100c6c549 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.456071 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a3e123f1-b689-4715-804d-c34100c6c549 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.457475 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a3e123f1-b689-4715-804d-c34100c6c549 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.597895 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0982d9e6-68f2-4460-876d-3bc23a35b8e4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:02.605566 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0982d9e6-68f2-4460-876d-3bc23a35b8e4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.184942 Jan 28 02:03:02.606221 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 147/282] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:02 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:02.612439 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-39cce84b-77a6-4953-a94e-7b73063af3c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:02.613368 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-39cce84b-77a6-4953-a94e-7b73063af3c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:02.619356 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-39cce84b-77a6-4953-a94e-7b73063af3c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.619793 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-39cce84b-77a6-4953-a94e-7b73063af3c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.620681 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-39cce84b-77a6-4953-a94e-7b73063af3c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.621111 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-39cce84b-77a6-4953-a94e-7b73063af3c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.632723 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a3e123f1-b689-4715-804d-c34100c6c549 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28597 microversion: 2.20 time: 0.195019 Jan 28 02:03:02.633588 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 136/283] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:02 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28597 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:03:02.646324 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-39cce84b-77a6-4953-a94e-7b73063af3c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lazy-loading 'flavor' on Instance uuid 706d03a1-cf66-4cdb-8271-bb94ca669ad7 {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:03:02.752596 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-39cce84b-77a6-4953-a94e-7b73063af3c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "POST /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/action" status: 200 len: 32 microversion: 2.1 time: 0.144557 Jan 28 02:03:02.754319 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 148/284] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:03:02 2022] POST /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/action => generated 32 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:03:02.763996 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-780ce8b6-4d20-4643-a74b-0bf3bb5e6fd1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:02.765284 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-780ce8b6-4d20-4643-a74b-0bf3bb5e6fd1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:02.775064 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-780ce8b6-4d20-4643-a74b-0bf3bb5e6fd1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.775550 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-780ce8b6-4d20-4643-a74b-0bf3bb5e6fd1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.776342 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-780ce8b6-4d20-4643-a74b-0bf3bb5e6fd1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.776796 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-780ce8b6-4d20-4643-a74b-0bf3bb5e6fd1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.991628 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-780ce8b6-4d20-4643-a74b-0bf3bb5e6fd1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:03.001195 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-780ce8b6-4d20-4643-a74b-0bf3bb5e6fd1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.241486 Jan 28 02:03:03.009558 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 137/285] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:02 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:03.432385 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-53ee741c-83ed-45a5-a2c5-e7a94bdfe96c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:03.433126 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-53ee741c-83ed-45a5-a2c5-e7a94bdfe96c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:03.440084 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-53ee741c-83ed-45a5-a2c5-e7a94bdfe96c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:03.440530 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-53ee741c-83ed-45a5-a2c5-e7a94bdfe96c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:03.441303 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-53ee741c-83ed-45a5-a2c5-e7a94bdfe96c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:03.441736 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-53ee741c-83ed-45a5-a2c5-e7a94bdfe96c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:03.576900 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-53ee741c-83ed-45a5-a2c5-e7a94bdfe96c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:03.584281 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-53ee741c-83ed-45a5-a2c5-e7a94bdfe96c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1507 microversion: 2.1 time: 0.155954 Jan 28 02:03:03.584838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 149/286] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:03 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:03.624489 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8cfe0be0-1821-4931-9d35-a3fd57d228d4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:03.625160 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8cfe0be0-1821-4931-9d35-a3fd57d228d4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:03.631283 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8cfe0be0-1821-4931-9d35-a3fd57d228d4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:03.632011 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8cfe0be0-1821-4931-9d35-a3fd57d228d4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:03.632496 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8cfe0be0-1821-4931-9d35-a3fd57d228d4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:03.633011 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8cfe0be0-1821-4931-9d35-a3fd57d228d4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:03.644536 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6824238a-fa56-4895-a5e6-ac9721d62d26 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:03.645527 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6824238a-fa56-4895-a5e6-ac9721d62d26 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:03.652822 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6824238a-fa56-4895-a5e6-ac9721d62d26 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:03.653369 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6824238a-fa56-4895-a5e6-ac9721d62d26 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:03.654401 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6824238a-fa56-4895-a5e6-ac9721d62d26 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:03.654906 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6824238a-fa56-4895-a5e6-ac9721d62d26 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:03.765217 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8cfe0be0-1821-4931-9d35-a3fd57d228d4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:03.775513 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8cfe0be0-1821-4931-9d35-a3fd57d228d4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.155236 Jan 28 02:03:03.776214 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 138/287] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:03 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:03.789991 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6824238a-fa56-4895-a5e6-ac9721d62d26 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28597 microversion: 2.20 time: 0.148734 Jan 28 02:03:03.792345 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 150/288] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:03 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28597 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:04.027611 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-0118b3da-c95d-4266-8e2e-6bbe66fdf804 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:04.028279 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-0118b3da-c95d-4266-8e2e-6bbe66fdf804 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:04.034839 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0118b3da-c95d-4266-8e2e-6bbe66fdf804 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:04.035292 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0118b3da-c95d-4266-8e2e-6bbe66fdf804 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:04.036094 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0118b3da-c95d-4266-8e2e-6bbe66fdf804 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:04.036574 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0118b3da-c95d-4266-8e2e-6bbe66fdf804 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:04.170472 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-0118b3da-c95d-4266-8e2e-6bbe66fdf804 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:04.178253 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-0118b3da-c95d-4266-8e2e-6bbe66fdf804 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.154676 Jan 28 02:03:04.178889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 139/289] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:04 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:04.793987 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-343fe1e5-f350-445f-994d-a2eb90d22d8e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:04.794681 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-343fe1e5-f350-445f-994d-a2eb90d22d8e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:04.801461 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-343fe1e5-f350-445f-994d-a2eb90d22d8e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:04.801951 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-343fe1e5-f350-445f-994d-a2eb90d22d8e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:04.802235 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-523f3ab3-ef6d-4acd-814b-7a6edeeefcd3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:04.802811 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-343fe1e5-f350-445f-994d-a2eb90d22d8e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:04.803269 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-343fe1e5-f350-445f-994d-a2eb90d22d8e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:04.803390 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-523f3ab3-ef6d-4acd-814b-7a6edeeefcd3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:04.819428 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-523f3ab3-ef6d-4acd-814b-7a6edeeefcd3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:04.819867 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-523f3ab3-ef6d-4acd-814b-7a6edeeefcd3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:04.820627 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-523f3ab3-ef6d-4acd-814b-7a6edeeefcd3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:04.821053 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-523f3ab3-ef6d-4acd-814b-7a6edeeefcd3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:04.945734 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-343fe1e5-f350-445f-994d-a2eb90d22d8e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:04.954538 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-343fe1e5-f350-445f-994d-a2eb90d22d8e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.164125 Jan 28 02:03:04.964202 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 151/290] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:04 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:04.964648 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-523f3ab3-ef6d-4acd-814b-7a6edeeefcd3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28597 microversion: 2.20 time: 0.158546 Jan 28 02:03:04.964648 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 140/291] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:04 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:04.964813 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7cef319f-8a28-4316-afa8-556d4b17aa50 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da5b2c39-b9e6-410f-84da-e88f7ad9752e"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:04.965313 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7cef319f-8a28-4316-afa8-556d4b17aa50 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:04.971612 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7cef319f-8a28-4316-afa8-556d4b17aa50 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:04.972049 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7cef319f-8a28-4316-afa8-556d4b17aa50 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:04.972806 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7cef319f-8a28-4316-afa8-556d4b17aa50 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:04.973231 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7cef319f-8a28-4316-afa8-556d4b17aa50 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:05.197033 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ad500032-d540-4c9c-8be4-16345c470c88 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:05.197773 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ad500032-d540-4c9c-8be4-16345c470c88 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:05.205788 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ad500032-d540-4c9c-8be4-16345c470c88 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:05.206269 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ad500032-d540-4c9c-8be4-16345c470c88 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:05.207101 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ad500032-d540-4c9c-8be4-16345c470c88 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:05.207604 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ad500032-d540-4c9c-8be4-16345c470c88 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:05.295292 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7cef319f-8a28-4316-afa8-556d4b17aa50 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "POST /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337962 Jan 28 02:03:05.301885 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 152/292] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:03:04 2022] POST /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:05.364870 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ad500032-d540-4c9c-8be4-16345c470c88 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:05.378785 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ad500032-d540-4c9c-8be4-16345c470c88 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.183739 Jan 28 02:03:05.378785 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 141/293] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:05 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:05.973701 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e6c57c1a-e028-4a31-8e96-ef643571cef7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:05.975366 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-17190447-28c2-4b6d-af9e-17cc08efc0ae tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:05.976474 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-17190447-28c2-4b6d-af9e-17cc08efc0ae tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:05.977488 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e6c57c1a-e028-4a31-8e96-ef643571cef7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:05.989379 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e6c57c1a-e028-4a31-8e96-ef643571cef7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:05.990494 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e6c57c1a-e028-4a31-8e96-ef643571cef7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:05.992056 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e6c57c1a-e028-4a31-8e96-ef643571cef7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:05.993003 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e6c57c1a-e028-4a31-8e96-ef643571cef7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:05.993534 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-17190447-28c2-4b6d-af9e-17cc08efc0ae tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:05.994434 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-17190447-28c2-4b6d-af9e-17cc08efc0ae tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:05.995854 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-17190447-28c2-4b6d-af9e-17cc08efc0ae tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:05.997001 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-17190447-28c2-4b6d-af9e-17cc08efc0ae tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:06.141925 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e6c57c1a-e028-4a31-8e96-ef643571cef7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28597 microversion: 2.20 time: 0.174587 Jan 28 02:03:06.142935 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 153/294] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:05 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28597 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:06.301595 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-17190447-28c2-4b6d-af9e-17cc08efc0ae tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:06.317479 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-17190447-28c2-4b6d-af9e-17cc08efc0ae tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.348144 Jan 28 02:03:06.326408 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 142/295] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:05 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:06.397647 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-836369b6-aa82-4221-8daa-85e2babff484 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:06.398921 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-836369b6-aa82-4221-8daa-85e2babff484 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:06.419873 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-836369b6-aa82-4221-8daa-85e2babff484 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:06.421092 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-836369b6-aa82-4221-8daa-85e2babff484 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:06.422345 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-836369b6-aa82-4221-8daa-85e2babff484 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:06.423038 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-836369b6-aa82-4221-8daa-85e2babff484 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:06.598384 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-836369b6-aa82-4221-8daa-85e2babff484 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:06.606836 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-836369b6-aa82-4221-8daa-85e2babff484 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.216416 Jan 28 02:03:06.617944 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 154/296] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:06 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:07.156703 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-62f016ac-9db5-44da-b69d-71b742740759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:07.157660 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-62f016ac-9db5-44da-b69d-71b742740759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:07.163584 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-62f016ac-9db5-44da-b69d-71b742740759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:07.164172 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-62f016ac-9db5-44da-b69d-71b742740759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:07.165032 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-62f016ac-9db5-44da-b69d-71b742740759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:07.165557 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-62f016ac-9db5-44da-b69d-71b742740759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:07.298800 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-62f016ac-9db5-44da-b69d-71b742740759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28597 microversion: 2.20 time: 0.146351 Jan 28 02:03:07.299683 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 143/297] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:07 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28597 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:07.342094 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1b40ad90-c7d8-46ed-a24c-dc475988831f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:07.343259 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1b40ad90-c7d8-46ed-a24c-dc475988831f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:07.348999 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b40ad90-c7d8-46ed-a24c-dc475988831f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:07.349501 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b40ad90-c7d8-46ed-a24c-dc475988831f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:07.350303 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b40ad90-c7d8-46ed-a24c-dc475988831f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:07.350734 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b40ad90-c7d8-46ed-a24c-dc475988831f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:07.490510 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1b40ad90-c7d8-46ed-a24c-dc475988831f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:07.498213 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1b40ad90-c7d8-46ed-a24c-dc475988831f tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.159557 Jan 28 02:03:07.498732 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 155/298] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:07 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:07.626135 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b16f81b0-3b00-4d38-a1bd-473d89030026 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:07.626894 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b16f81b0-3b00-4d38-a1bd-473d89030026 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:07.633319 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b16f81b0-3b00-4d38-a1bd-473d89030026 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:07.633967 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b16f81b0-3b00-4d38-a1bd-473d89030026 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:07.643245 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b16f81b0-3b00-4d38-a1bd-473d89030026 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:07.643245 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b16f81b0-3b00-4d38-a1bd-473d89030026 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:07.763691 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b16f81b0-3b00-4d38-a1bd-473d89030026 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:07.770847 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b16f81b0-3b00-4d38-a1bd-473d89030026 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.149827 Jan 28 02:03:07.771401 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 144/299] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:07 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:08.310713 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4abb584c-1802-45de-9a24-df4743c32506 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:08.312607 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4abb584c-1802-45de-9a24-df4743c32506 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:08.320280 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4abb584c-1802-45de-9a24-df4743c32506 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:08.320821 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4abb584c-1802-45de-9a24-df4743c32506 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:08.321673 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4abb584c-1802-45de-9a24-df4743c32506 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:08.322170 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4abb584c-1802-45de-9a24-df4743c32506 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:08.427343 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4abb584c-1802-45de-9a24-df4743c32506 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28597 microversion: 2.20 time: 0.120170 Jan 28 02:03:08.431687 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 156/300] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:08 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28597 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:08.516087 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f4899c1e-3e8c-4c52-89f7-db1596f11b6e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:08.516914 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f4899c1e-3e8c-4c52-89f7-db1596f11b6e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:08.522921 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f4899c1e-3e8c-4c52-89f7-db1596f11b6e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:08.523372 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f4899c1e-3e8c-4c52-89f7-db1596f11b6e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:08.524127 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f4899c1e-3e8c-4c52-89f7-db1596f11b6e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:08.524558 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f4899c1e-3e8c-4c52-89f7-db1596f11b6e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:08.573083 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-2a05f8db-af89-4e32-8288-7db43b7572e1 req-b324302b-ed5d-4928-bc88-3bad9e64037c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb6e346f-7608-43e4-a218-aaef2e657f0f", "name": "network-vif-plugged", "status": "completed", "tag": "74f004ac-1a79-4bd1-be0e-04fb236b29f4"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:08.576464 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:08.576464 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:03:08.587808 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-2a05f8db-af89-4e32-8288-7db43b7572e1 req-b324302b-ed5d-4928-bc88-3bad9e64037c service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:08.588261 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-2a05f8db-af89-4e32-8288-7db43b7572e1 req-b324302b-ed5d-4928-bc88-3bad9e64037c service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:08.603214 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-2a05f8db-af89-4e32-8288-7db43b7572e1 req-b324302b-ed5d-4928-bc88-3bad9e64037c service nova] Creating event network-vif-plugged:74f004ac-1a79-4bd1-be0e-04fb236b29f4 for instance cb6e346f-7608-43e4-a218-aaef2e657f0f on hv-cinder-82497 Jan 28 02:03:08.610050 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-2a05f8db-af89-4e32-8288-7db43b7572e1 req-b324302b-ed5d-4928-bc88-3bad9e64037c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044100 Jan 28 02:03:08.611047 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 157/301] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:03:08.690421 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-f4899c1e-3e8c-4c52-89f7-db1596f11b6e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:08.699646 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f4899c1e-3e8c-4c52-89f7-db1596f11b6e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.188076 Jan 28 02:03:08.700847 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 145/302] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:08 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:08.789716 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-37704cc2-9cf3-4ab4-a52f-9d393e36e5a2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:08.790560 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-37704cc2-9cf3-4ab4-a52f-9d393e36e5a2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:08.797120 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-37704cc2-9cf3-4ab4-a52f-9d393e36e5a2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:08.798064 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-37704cc2-9cf3-4ab4-a52f-9d393e36e5a2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:08.799082 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-37704cc2-9cf3-4ab4-a52f-9d393e36e5a2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:08.799788 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-37704cc2-9cf3-4ab4-a52f-9d393e36e5a2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:09.017455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-37704cc2-9cf3-4ab4-a52f-9d393e36e5a2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:09.022567 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-37704cc2-9cf3-4ab4-a52f-9d393e36e5a2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.237476 Jan 28 02:03:09.023141 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 158/303] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:08 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:09.440204 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b02d4911-3bf4-4d9e-89f5-6abb82d35266 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:09.441185 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b02d4911-3bf4-4d9e-89f5-6abb82d35266 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:09.447000 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b02d4911-3bf4-4d9e-89f5-6abb82d35266 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:09.447529 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b02d4911-3bf4-4d9e-89f5-6abb82d35266 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:09.448363 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b02d4911-3bf4-4d9e-89f5-6abb82d35266 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:09.448863 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b02d4911-3bf4-4d9e-89f5-6abb82d35266 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:09.716855 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b76c3655-7e20-4d4f-bcfb-5b2aae65e29d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:09.717933 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b76c3655-7e20-4d4f-bcfb-5b2aae65e29d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:09.724534 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b76c3655-7e20-4d4f-bcfb-5b2aae65e29d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:09.724971 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b76c3655-7e20-4d4f-bcfb-5b2aae65e29d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:09.725733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b76c3655-7e20-4d4f-bcfb-5b2aae65e29d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:09.726180 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b76c3655-7e20-4d4f-bcfb-5b2aae65e29d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:09.844426 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b76c3655-7e20-4d4f-bcfb-5b2aae65e29d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:09.851533 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b76c3655-7e20-4d4f-bcfb-5b2aae65e29d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.138296 Jan 28 02:03:09.852088 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 159/304] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:09 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:10.039734 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3b210e7c-59f4-4f7c-9962-947a6a4c772c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:10.040367 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3b210e7c-59f4-4f7c-9962-947a6a4c772c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:10.046056 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3b210e7c-59f4-4f7c-9962-947a6a4c772c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:10.046499 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3b210e7c-59f4-4f7c-9962-947a6a4c772c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:10.047268 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3b210e7c-59f4-4f7c-9962-947a6a4c772c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:10.047699 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3b210e7c-59f4-4f7c-9962-947a6a4c772c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:10.172770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3b210e7c-59f4-4f7c-9962-947a6a4c772c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:10.179963 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3b210e7c-59f4-4f7c-9962-947a6a4c772c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.143813 Jan 28 02:03:10.180523 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 160/305] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:10 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:10.868531 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-beada1a3-4370-41a8-a5a5-f3546e25bddb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:10.869168 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-beada1a3-4370-41a8-a5a5-f3546e25bddb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:10.874914 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-beada1a3-4370-41a8-a5a5-f3546e25bddb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:10.875357 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-beada1a3-4370-41a8-a5a5-f3546e25bddb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:10.876113 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-beada1a3-4370-41a8-a5a5-f3546e25bddb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:10.876539 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-beada1a3-4370-41a8-a5a5-f3546e25bddb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:10.995225 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-beada1a3-4370-41a8-a5a5-f3546e25bddb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:11.003058 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-beada1a3-4370-41a8-a5a5-f3546e25bddb tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.138199 Jan 28 02:03:11.003618 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 161/306] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:10 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:11.198164 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a5c7e172-cf33-43cc-b928-b8a5bdf59aa6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:11.198763 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a5c7e172-cf33-43cc-b928-b8a5bdf59aa6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:11.205537 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a5c7e172-cf33-43cc-b928-b8a5bdf59aa6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:11.206006 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a5c7e172-cf33-43cc-b928-b8a5bdf59aa6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:11.206763 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a5c7e172-cf33-43cc-b928-b8a5bdf59aa6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:11.207189 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a5c7e172-cf33-43cc-b928-b8a5bdf59aa6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:11.322987 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a5c7e172-cf33-43cc-b928-b8a5bdf59aa6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:11.330852 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a5c7e172-cf33-43cc-b928-b8a5bdf59aa6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.136358 Jan 28 02:03:11.331402 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 162/307] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:11 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:12.019619 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-9b5dbb1c-983b-482f-bafa-4b955db1e8c7 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:12.020235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-9b5dbb1c-983b-482f-bafa-4b955db1e8c7 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:12.026516 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9b5dbb1c-983b-482f-bafa-4b955db1e8c7 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:12.026957 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9b5dbb1c-983b-482f-bafa-4b955db1e8c7 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:12.027755 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9b5dbb1c-983b-482f-bafa-4b955db1e8c7 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:12.028183 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9b5dbb1c-983b-482f-bafa-4b955db1e8c7 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:12.041564 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b02d4911-3bf4-4d9e-89f5-6abb82d35266 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 28597 microversion: 2.20 time: 2.605828 Jan 28 02:03:12.043086 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 146/308] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:09 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 28597 bytes in 2607 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:12.154605 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-9b5dbb1c-983b-482f-bafa-4b955db1e8c7 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:12.162354 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-9b5dbb1c-983b-482f-bafa-4b955db1e8c7 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.146434 Jan 28 02:03:12.163122 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 163/309] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:12 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:12.347602 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-00da2d13-ab97-4364-bd15-fb9946729e5e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:12.348274 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-00da2d13-ab97-4364-bd15-fb9946729e5e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:12.354731 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-00da2d13-ab97-4364-bd15-fb9946729e5e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:12.355170 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-00da2d13-ab97-4364-bd15-fb9946729e5e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:12.355974 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-00da2d13-ab97-4364-bd15-fb9946729e5e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:12.356401 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-00da2d13-ab97-4364-bd15-fb9946729e5e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:12.482304 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-00da2d13-ab97-4364-bd15-fb9946729e5e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:12.489499 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-00da2d13-ab97-4364-bd15-fb9946729e5e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.145918 Jan 28 02:03:12.490088 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 147/310] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:12 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:13.052284 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1f6f1b2b-54ea-47ab-97ac-d26742fab8c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:13.053205 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1f6f1b2b-54ea-47ab-97ac-d26742fab8c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:13.059173 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1f6f1b2b-54ea-47ab-97ac-d26742fab8c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:13.059615 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1f6f1b2b-54ea-47ab-97ac-d26742fab8c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:13.060388 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1f6f1b2b-54ea-47ab-97ac-d26742fab8c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:13.060816 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1f6f1b2b-54ea-47ab-97ac-d26742fab8c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:13.178894 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-01fcaf6d-d2c1-43d4-a9b2-dd4475ad28d1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:13.179673 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-01fcaf6d-d2c1-43d4-a9b2-dd4475ad28d1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:13.185517 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-01fcaf6d-d2c1-43d4-a9b2-dd4475ad28d1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:13.186031 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-01fcaf6d-d2c1-43d4-a9b2-dd4475ad28d1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:13.187633 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-01fcaf6d-d2c1-43d4-a9b2-dd4475ad28d1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:13.188052 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-01fcaf6d-d2c1-43d4-a9b2-dd4475ad28d1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:13.307143 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-01fcaf6d-d2c1-43d4-a9b2-dd4475ad28d1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:13.315176 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-01fcaf6d-d2c1-43d4-a9b2-dd4475ad28d1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.140053 Jan 28 02:03:13.315726 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 148/311] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:13 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:13.508732 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-35bcd303-d23d-4287-9ae2-5e06a8839486 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:13.509250 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-35bcd303-d23d-4287-9ae2-5e06a8839486 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:13.517273 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-35bcd303-d23d-4287-9ae2-5e06a8839486 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:13.517983 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-35bcd303-d23d-4287-9ae2-5e06a8839486 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:13.519282 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-35bcd303-d23d-4287-9ae2-5e06a8839486 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:13.519820 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-35bcd303-d23d-4287-9ae2-5e06a8839486 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:13.642575 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-35bcd303-d23d-4287-9ae2-5e06a8839486 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:13.649707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-35bcd303-d23d-4287-9ae2-5e06a8839486 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.146641 Jan 28 02:03:13.650281 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 149/312] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:13 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:14.332182 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-761ded6b-09ff-44fa-be61-e615fa3be741 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:14.332776 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-761ded6b-09ff-44fa-be61-e615fa3be741 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:14.338540 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-761ded6b-09ff-44fa-be61-e615fa3be741 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:14.338980 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-761ded6b-09ff-44fa-be61-e615fa3be741 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:14.339753 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-761ded6b-09ff-44fa-be61-e615fa3be741 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:14.340175 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-761ded6b-09ff-44fa-be61-e615fa3be741 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:14.461177 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-761ded6b-09ff-44fa-be61-e615fa3be741 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:14.468592 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-761ded6b-09ff-44fa-be61-e615fa3be741 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.139993 Jan 28 02:03:14.469204 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 150/313] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:14 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:14.666712 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6bba0776-fbaf-4a69-8d43-8f01df33774b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:14.667321 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6bba0776-fbaf-4a69-8d43-8f01df33774b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:14.673679 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6bba0776-fbaf-4a69-8d43-8f01df33774b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:14.674151 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6bba0776-fbaf-4a69-8d43-8f01df33774b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:14.674924 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6bba0776-fbaf-4a69-8d43-8f01df33774b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:14.675352 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6bba0776-fbaf-4a69-8d43-8f01df33774b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:14.792282 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6bba0776-fbaf-4a69-8d43-8f01df33774b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:14.802806 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6bba0776-fbaf-4a69-8d43-8f01df33774b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.139690 Jan 28 02:03:14.803373 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 151/314] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:14 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:15.450898 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1f6f1b2b-54ea-47ab-97ac-d26742fab8c9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 31979 microversion: 2.20 time: 2.401876 Jan 28 02:03:15.452488 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 164/315] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:13 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 31979 bytes in 2404 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:15.485600 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2878ae62-d763-4595-b869-2ebd9b5fc212 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:15.486185 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2878ae62-d763-4595-b869-2ebd9b5fc212 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:15.491903 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2878ae62-d763-4595-b869-2ebd9b5fc212 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:15.492338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2878ae62-d763-4595-b869-2ebd9b5fc212 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:15.493178 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2878ae62-d763-4595-b869-2ebd9b5fc212 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:15.493599 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2878ae62-d763-4595-b869-2ebd9b5fc212 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:15.648197 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-2878ae62-d763-4595-b869-2ebd9b5fc212 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:15.655971 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2878ae62-d763-4595-b869-2ebd9b5fc212 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1313 microversion: 2.1 time: 0.174844 Jan 28 02:03:15.656559 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 152/316] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:15 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:15.820072 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-010d6d2e-91b1-4285-bbda-9857749b15c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:15.820760 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-010d6d2e-91b1-4285-bbda-9857749b15c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:15.827870 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-010d6d2e-91b1-4285-bbda-9857749b15c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:15.828306 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-010d6d2e-91b1-4285-bbda-9857749b15c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:15.829081 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-010d6d2e-91b1-4285-bbda-9857749b15c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:15.829510 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-010d6d2e-91b1-4285-bbda-9857749b15c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:16.062144 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-010d6d2e-91b1-4285-bbda-9857749b15c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:16.070223 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-010d6d2e-91b1-4285-bbda-9857749b15c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.254038 Jan 28 02:03:16.071424 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 165/317] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:15 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:16.463441 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ce50e7f4-f7a2-4b71-a5a4-7c8754c90731 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:16.464350 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ce50e7f4-f7a2-4b71-a5a4-7c8754c90731 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:16.470236 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ce50e7f4-f7a2-4b71-a5a4-7c8754c90731 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:16.470678 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ce50e7f4-f7a2-4b71-a5a4-7c8754c90731 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:16.471434 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ce50e7f4-f7a2-4b71-a5a4-7c8754c90731 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:16.471856 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ce50e7f4-f7a2-4b71-a5a4-7c8754c90731 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:16.673033 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0b490d39-f336-433c-b5e9-0dc02d0ca557 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:16.673565 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0b490d39-f336-433c-b5e9-0dc02d0ca557 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:16.679552 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0b490d39-f336-433c-b5e9-0dc02d0ca557 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:16.679995 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0b490d39-f336-433c-b5e9-0dc02d0ca557 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:16.680761 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0b490d39-f336-433c-b5e9-0dc02d0ca557 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:16.681249 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0b490d39-f336-433c-b5e9-0dc02d0ca557 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:16.683951 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ce50e7f4-f7a2-4b71-a5a4-7c8754c90731 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 32475 microversion: 2.20 time: 0.224075 Jan 28 02:03:16.685288 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 153/318] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:16 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 32475 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:16.801316 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0b490d39-f336-433c-b5e9-0dc02d0ca557 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:16.808571 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0b490d39-f336-433c-b5e9-0dc02d0ca557 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1496 microversion: 2.1 time: 0.140044 Jan 28 02:03:16.809136 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 166/319] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:16 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1496 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:17.092271 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c24dd582-cf72-4c30-a156-b4dbb2ef480e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:17.093831 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c24dd582-cf72-4c30-a156-b4dbb2ef480e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:17.101207 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c24dd582-cf72-4c30-a156-b4dbb2ef480e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.101989 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c24dd582-cf72-4c30-a156-b4dbb2ef480e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.103251 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c24dd582-cf72-4c30-a156-b4dbb2ef480e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.104088 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c24dd582-cf72-4c30-a156-b4dbb2ef480e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.189723 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7955c18d-d439-41a4-9438-203d0f734ceb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da5b2c39-b9e6-410f-84da-e88f7ad9752e"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:17.190809 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7955c18d-d439-41a4-9438-203d0f734ceb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:17.200056 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7955c18d-d439-41a4-9438-203d0f734ceb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.200827 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7955c18d-d439-41a4-9438-203d0f734ceb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.204034 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7955c18d-d439-41a4-9438-203d0f734ceb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.205397 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7955c18d-d439-41a4-9438-203d0f734ceb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.275257 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c24dd582-cf72-4c30-a156-b4dbb2ef480e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:17.283329 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c24dd582-cf72-4c30-a156-b4dbb2ef480e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.196080 Jan 28 02:03:17.283889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 154/320] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:17 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:17.447268 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-7955c18d-d439-41a4-9438-203d0f734ceb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] HTTP exception thrown: Invalid volume: volume da5b2c39-b9e6-410f-84da-e88f7ad9752e is already attached to instances: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e Jan 28 02:03:17.447946 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7955c18d-d439-41a4-9438-203d0f734ceb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Returning 400 to user: Invalid volume: volume da5b2c39-b9e6-410f-84da-e88f7ad9752e is already attached to instances: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:03:17.448869 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7955c18d-d439-41a4-9438-203d0f734ceb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "POST /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.264285 Jan 28 02:03:17.449518 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 167/321] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:03:17 2022] POST /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments => generated 174 bytes in 265 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 28 02:03:17.590895 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-00326141-68fb-40dc-a951-74e4e1169649 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:17.591381 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-00326141-68fb-40dc-a951-74e4e1169649 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:17.597060 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-00326141-68fb-40dc-a951-74e4e1169649 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.597500 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-00326141-68fb-40dc-a951-74e4e1169649 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.598303 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-00326141-68fb-40dc-a951-74e4e1169649 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.598733 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-00326141-68fb-40dc-a951-74e4e1169649 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.698380 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a22e8875-12dd-4f9e-a69a-8cb0eeacfbc7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:17.699342 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a22e8875-12dd-4f9e-a69a-8cb0eeacfbc7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:17.705460 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a22e8875-12dd-4f9e-a69a-8cb0eeacfbc7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.705954 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a22e8875-12dd-4f9e-a69a-8cb0eeacfbc7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.706734 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a22e8875-12dd-4f9e-a69a-8cb0eeacfbc7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.707158 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a22e8875-12dd-4f9e-a69a-8cb0eeacfbc7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.730161 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.objects.instance [None req-00326141-68fb-40dc-a951-74e4e1169649 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lazy-loading 'services' on Instance uuid 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e {{(pid=115760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:03:17.975157 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-00326141-68fb-40dc-a951-74e4e1169649 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "DELETE /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments/da5b2c39-b9e6-410f-84da-e88f7ad9752e" status: 202 len: 0 microversion: 2.1 time: 0.387702 Jan 28 02:03:17.975661 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 155/322] 10.222.0.77 () {58 vars in 1415 bytes} [Fri Jan 28 02:03:17 2022] DELETE /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments/da5b2c39-b9e6-410f-84da-e88f7ad9752e => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:17.980671 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f79d2272-72a7-47e3-9d33-ec1f73f91a3c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:17.981246 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f79d2272-72a7-47e3-9d33-ec1f73f91a3c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:17.987714 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f79d2272-72a7-47e3-9d33-ec1f73f91a3c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.988157 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f79d2272-72a7-47e3-9d33-ec1f73f91a3c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.988919 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f79d2272-72a7-47e3-9d33-ec1f73f91a3c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.989348 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f79d2272-72a7-47e3-9d33-ec1f73f91a3c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:18.013845 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f79d2272-72a7-47e3-9d33-ec1f73f91a3c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:03:18.096209 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f79d2272-72a7-47e3-9d33-ec1f73f91a3c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "DELETE /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 204 len: 0 microversion: 2.1 time: 0.119055 Jan 28 02:03:18.096779 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 156/323] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:03:17 2022] DELETE /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:03:18.101759 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4f6fa8a1-69a6-4e39-841c-66bbe67ca6a9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:18.102809 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4f6fa8a1-69a6-4e39-841c-66bbe67ca6a9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:18.109920 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4f6fa8a1-69a6-4e39-841c-66bbe67ca6a9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:18.110361 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4f6fa8a1-69a6-4e39-841c-66bbe67ca6a9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:18.111125 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4f6fa8a1-69a6-4e39-841c-66bbe67ca6a9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:18.111552 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4f6fa8a1-69a6-4e39-841c-66bbe67ca6a9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:18.139561 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4f6fa8a1-69a6-4e39-841c-66bbe67ca6a9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041644 Jan 28 02:03:18.140109 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 157/324] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:03:18 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:18.145130 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-26de85e2-23f8-4656-b78c-4ad111bb6dee tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:18.145721 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-26de85e2-23f8-4656-b78c-4ad111bb6dee tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:18.151199 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26de85e2-23f8-4656-b78c-4ad111bb6dee tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:18.151638 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26de85e2-23f8-4656-b78c-4ad111bb6dee tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:18.152394 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26de85e2-23f8-4656-b78c-4ad111bb6dee tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:18.152823 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26de85e2-23f8-4656-b78c-4ad111bb6dee tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:18.284054 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-26de85e2-23f8-4656-b78c-4ad111bb6dee tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:18.291379 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-26de85e2-23f8-4656-b78c-4ad111bb6dee tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1502 microversion: 2.1 time: 0.149599 Jan 28 02:03:18.291934 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 158/325] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:18 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:18.300670 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-461a5f70-77ad-4f58-8e09-0b2d13584ff1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:18.301263 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-461a5f70-77ad-4f58-8e09-0b2d13584ff1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:18.307214 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-461a5f70-77ad-4f58-8e09-0b2d13584ff1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:18.307655 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-461a5f70-77ad-4f58-8e09-0b2d13584ff1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:18.308453 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-461a5f70-77ad-4f58-8e09-0b2d13584ff1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:18.308878 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-461a5f70-77ad-4f58-8e09-0b2d13584ff1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:18.429762 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-461a5f70-77ad-4f58-8e09-0b2d13584ff1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:18.437060 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-461a5f70-77ad-4f58-8e09-0b2d13584ff1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.140136 Jan 28 02:03:18.437901 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 159/326] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:18 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:19.151356 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7de1781e-831b-4c5a-9ba6-2d9a0ded9918 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:19.152325 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7de1781e-831b-4c5a-9ba6-2d9a0ded9918 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:19.158270 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7de1781e-831b-4c5a-9ba6-2d9a0ded9918 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:19.158713 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7de1781e-831b-4c5a-9ba6-2d9a0ded9918 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:19.159478 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7de1781e-831b-4c5a-9ba6-2d9a0ded9918 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:19.159908 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7de1781e-831b-4c5a-9ba6-2d9a0ded9918 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:19.189807 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7de1781e-831b-4c5a-9ba6-2d9a0ded9918 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042251 Jan 28 02:03:19.190356 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 160/327] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:03:19 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:03:19.308939 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5ab583c6-017e-430b-a2cc-93b69a44dd57 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:19.309534 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5ab583c6-017e-430b-a2cc-93b69a44dd57 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:19.316305 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5ab583c6-017e-430b-a2cc-93b69a44dd57 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:19.316751 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5ab583c6-017e-430b-a2cc-93b69a44dd57 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:19.317540 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5ab583c6-017e-430b-a2cc-93b69a44dd57 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:19.318001 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5ab583c6-017e-430b-a2cc-93b69a44dd57 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:19.440341 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5ab583c6-017e-430b-a2cc-93b69a44dd57 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:19.447556 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5ab583c6-017e-430b-a2cc-93b69a44dd57 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1502 microversion: 2.1 time: 0.142279 Jan 28 02:03:19.448331 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 161/328] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:19 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1502 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:19.453534 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b99c6089-87c0-4ec0-b33d-6ba148913c4d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:19.454154 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b99c6089-87c0-4ec0-b33d-6ba148913c4d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:19.459741 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b99c6089-87c0-4ec0-b33d-6ba148913c4d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:19.460177 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b99c6089-87c0-4ec0-b33d-6ba148913c4d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:19.460936 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b99c6089-87c0-4ec0-b33d-6ba148913c4d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:19.461359 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b99c6089-87c0-4ec0-b33d-6ba148913c4d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:19.580151 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b99c6089-87c0-4ec0-b33d-6ba148913c4d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:19.589533 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b99c6089-87c0-4ec0-b33d-6ba148913c4d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.139382 Jan 28 02:03:19.590272 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 162/329] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:19 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:20.201168 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-107cebf7-8a33-43dc-9500-e97f1fa9a460 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:20.202592 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-107cebf7-8a33-43dc-9500-e97f1fa9a460 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:20.208756 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-107cebf7-8a33-43dc-9500-e97f1fa9a460 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:20.209191 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-107cebf7-8a33-43dc-9500-e97f1fa9a460 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:20.209987 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-107cebf7-8a33-43dc-9500-e97f1fa9a460 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:20.210413 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-107cebf7-8a33-43dc-9500-e97f1fa9a460 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:20.239641 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-107cebf7-8a33-43dc-9500-e97f1fa9a460 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042219 Jan 28 02:03:20.240186 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 163/330] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:03:20 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:03:20.464637 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1871d23b-9f24-41e0-a308-a9706bf04f3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:20.465159 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1871d23b-9f24-41e0-a308-a9706bf04f3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:20.472821 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1871d23b-9f24-41e0-a308-a9706bf04f3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:20.473572 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1871d23b-9f24-41e0-a308-a9706bf04f3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:20.474644 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1871d23b-9f24-41e0-a308-a9706bf04f3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:20.475120 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1871d23b-9f24-41e0-a308-a9706bf04f3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:20.593883 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-1871d23b-9f24-41e0-a308-a9706bf04f3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:20.601847 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1871d23b-9f24-41e0-a308-a9706bf04f3b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1502 microversion: 2.1 time: 0.140894 Jan 28 02:03:20.602419 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 164/331] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:20 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1502 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:20.606768 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-74311f33-f4fd-490b-9681-788019b277b4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:20.607366 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-74311f33-f4fd-490b-9681-788019b277b4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:20.616763 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-74311f33-f4fd-490b-9681-788019b277b4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:20.617182 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-74311f33-f4fd-490b-9681-788019b277b4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:20.617995 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-74311f33-f4fd-490b-9681-788019b277b4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:20.618422 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-74311f33-f4fd-490b-9681-788019b277b4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:20.695858 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a22e8875-12dd-4f9e-a69a-8cb0eeacfbc7 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 33171 microversion: 2.20 time: 3.000932 Jan 28 02:03:20.696886 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 168/332] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:17 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 33171 bytes in 3003 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:20.749685 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-74311f33-f4fd-490b-9681-788019b277b4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:20.756893 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-74311f33-f4fd-490b-9681-788019b277b4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.153536 Jan 28 02:03:20.757452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 165/333] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:20 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:21.251668 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bdd2096d-6440-4531-8d72-0f8b6b7efd19 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:21.252682 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bdd2096d-6440-4531-8d72-0f8b6b7efd19 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:21.259185 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bdd2096d-6440-4531-8d72-0f8b6b7efd19 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:21.259625 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bdd2096d-6440-4531-8d72-0f8b6b7efd19 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:21.260392 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bdd2096d-6440-4531-8d72-0f8b6b7efd19 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:21.260819 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bdd2096d-6440-4531-8d72-0f8b6b7efd19 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:21.289992 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-bdd2096d-6440-4531-8d72-0f8b6b7efd19 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042497 Jan 28 02:03:21.290543 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 169/334] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:03:21 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:21.619825 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d4898436-5395-4b6b-b482-4eed8bff206c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:21.620366 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d4898436-5395-4b6b-b482-4eed8bff206c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:21.627146 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d4898436-5395-4b6b-b482-4eed8bff206c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:21.627581 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d4898436-5395-4b6b-b482-4eed8bff206c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:21.628482 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d4898436-5395-4b6b-b482-4eed8bff206c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:21.628798 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d4898436-5395-4b6b-b482-4eed8bff206c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:21.709278 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b959a3ab-6cc2-4656-8a66-cb5bf69d6287 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:21.710405 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b959a3ab-6cc2-4656-8a66-cb5bf69d6287 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:21.719546 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b959a3ab-6cc2-4656-8a66-cb5bf69d6287 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:21.720349 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b959a3ab-6cc2-4656-8a66-cb5bf69d6287 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:21.721320 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b959a3ab-6cc2-4656-8a66-cb5bf69d6287 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:21.721794 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b959a3ab-6cc2-4656-8a66-cb5bf69d6287 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:21.761214 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d4898436-5395-4b6b-b482-4eed8bff206c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:21.772206 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d4898436-5395-4b6b-b482-4eed8bff206c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1502 microversion: 2.1 time: 0.156500 Jan 28 02:03:21.773213 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 166/335] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:21 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:21.780736 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-92b57184-b956-416a-82d7-b5da4c85eb06 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:21.781721 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-92b57184-b956-416a-82d7-b5da4c85eb06 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:21.790880 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-92b57184-b956-416a-82d7-b5da4c85eb06 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:21.791488 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-92b57184-b956-416a-82d7-b5da4c85eb06 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:21.792749 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-92b57184-b956-416a-82d7-b5da4c85eb06 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:21.793463 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-92b57184-b956-416a-82d7-b5da4c85eb06 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:21.942084 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-92b57184-b956-416a-82d7-b5da4c85eb06 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:21.949489 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-92b57184-b956-416a-82d7-b5da4c85eb06 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.174842 Jan 28 02:03:21.950115 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 167/336] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:21 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:22.304473 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-638c5600-d4dd-4cc8-85f9-d84e317da8d5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:22.305398 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-638c5600-d4dd-4cc8-85f9-d84e317da8d5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:22.311307 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-638c5600-d4dd-4cc8-85f9-d84e317da8d5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:22.311749 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-638c5600-d4dd-4cc8-85f9-d84e317da8d5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:22.312512 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-638c5600-d4dd-4cc8-85f9-d84e317da8d5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:22.313190 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-638c5600-d4dd-4cc8-85f9-d84e317da8d5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:22.343924 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-638c5600-d4dd-4cc8-85f9-d84e317da8d5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 Jan 28 02:03:22.344494 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 168/337] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:03:22 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:03:22.790011 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-60607bfb-4e24-45a4-9a1b-9476395c283b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:22.790665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-60607bfb-4e24-45a4-9a1b-9476395c283b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:22.797086 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-60607bfb-4e24-45a4-9a1b-9476395c283b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:22.797524 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-60607bfb-4e24-45a4-9a1b-9476395c283b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:22.798700 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-60607bfb-4e24-45a4-9a1b-9476395c283b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:22.799131 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-60607bfb-4e24-45a4-9a1b-9476395c283b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:22.927282 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-60607bfb-4e24-45a4-9a1b-9476395c283b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:22.934549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-60607bfb-4e24-45a4-9a1b-9476395c283b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1502 microversion: 2.1 time: 0.148110 Jan 28 02:03:22.935111 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 169/338] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:22 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:22.966648 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-25832a4c-9a50-403b-adfd-a5b896b88cbb tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:22.967889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-25832a4c-9a50-403b-adfd-a5b896b88cbb tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:22.973713 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-25832a4c-9a50-403b-adfd-a5b896b88cbb tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:22.974180 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-25832a4c-9a50-403b-adfd-a5b896b88cbb tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:22.975055 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-25832a4c-9a50-403b-adfd-a5b896b88cbb tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:22.975478 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-25832a4c-9a50-403b-adfd-a5b896b88cbb tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:23.104193 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-25832a4c-9a50-403b-adfd-a5b896b88cbb tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:23.111701 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-25832a4c-9a50-403b-adfd-a5b896b88cbb tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.149064 Jan 28 02:03:23.112292 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 170/339] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:22 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:23.356146 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3bf1333f-5eb0-4754-9521-342c8672673e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:23.357002 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3bf1333f-5eb0-4754-9521-342c8672673e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:23.367560 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3bf1333f-5eb0-4754-9521-342c8672673e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:23.368344 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3bf1333f-5eb0-4754-9521-342c8672673e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:23.369167 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3bf1333f-5eb0-4754-9521-342c8672673e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:23.369604 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3bf1333f-5eb0-4754-9521-342c8672673e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:23.406341 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3bf1333f-5eb0-4754-9521-342c8672673e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054750 Jan 28 02:03:23.407013 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 171/340] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:03:23 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:03:23.952061 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d4c4e34d-49b6-45a0-835c-4f6b9aa96ba6 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:23.952854 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d4c4e34d-49b6-45a0-835c-4f6b9aa96ba6 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:23.959122 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d4c4e34d-49b6-45a0-835c-4f6b9aa96ba6 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:23.959809 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d4c4e34d-49b6-45a0-835c-4f6b9aa96ba6 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:23.960799 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d4c4e34d-49b6-45a0-835c-4f6b9aa96ba6 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:23.961223 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d4c4e34d-49b6-45a0-835c-4f6b9aa96ba6 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:24.267337 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d4c4e34d-49b6-45a0-835c-4f6b9aa96ba6 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:24.277400 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d4c4e34d-49b6-45a0-835c-4f6b9aa96ba6 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1502 microversion: 2.1 time: 0.329087 Jan 28 02:03:24.278011 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 172/341] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:23 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1502 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:24.283371 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1bafc9bb-6067-4156-8380-a0fdc1fcc41b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:24.284148 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1bafc9bb-6067-4156-8380-a0fdc1fcc41b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:24.290256 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1bafc9bb-6067-4156-8380-a0fdc1fcc41b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:24.290701 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1bafc9bb-6067-4156-8380-a0fdc1fcc41b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:24.291481 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1bafc9bb-6067-4156-8380-a0fdc1fcc41b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:24.291916 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1bafc9bb-6067-4156-8380-a0fdc1fcc41b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:24.521369 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b959a3ab-6cc2-4656-8a66-cb5bf69d6287 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 36893 microversion: 2.20 time: 2.816983 Jan 28 02:03:24.522527 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 170/342] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:21 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 36893 bytes in 2819 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:03:24.529185 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4a7d9e5b-e82c-4cab-b7b5-677fad879122 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:24.530771 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4a7d9e5b-e82c-4cab-b7b5-677fad879122 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:24.539178 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4a7d9e5b-e82c-4cab-b7b5-677fad879122 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:24.539634 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4a7d9e5b-e82c-4cab-b7b5-677fad879122 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:24.541186 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4a7d9e5b-e82c-4cab-b7b5-677fad879122 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:24.541633 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4a7d9e5b-e82c-4cab-b7b5-677fad879122 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:24.554469 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-1bafc9bb-6067-4156-8380-a0fdc1fcc41b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:24.563561 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1bafc9bb-6067-4156-8380-a0fdc1fcc41b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.284300 Jan 28 02:03:24.573289 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 173/343] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:24 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:24.579120 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4a7d9e5b-e82c-4cab-b7b5-677fad879122 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054927 Jan 28 02:03:24.579696 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 171/344] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:03:24 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:25.295947 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e7a390bd-0a75-4113-8ecd-7d3591601c0d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:25.297991 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e7a390bd-0a75-4113-8ecd-7d3591601c0d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:25.307728 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e7a390bd-0a75-4113-8ecd-7d3591601c0d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:25.308178 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e7a390bd-0a75-4113-8ecd-7d3591601c0d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:25.308971 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e7a390bd-0a75-4113-8ecd-7d3591601c0d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:25.309401 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e7a390bd-0a75-4113-8ecd-7d3591601c0d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:25.533979 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-26c6cd84-9929-4b20-9cb3-7af13c96cd2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:25.534892 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-26c6cd84-9929-4b20-9cb3-7af13c96cd2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:25.544102 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-26c6cd84-9929-4b20-9cb3-7af13c96cd2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:25.544715 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-26c6cd84-9929-4b20-9cb3-7af13c96cd2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:25.546294 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-26c6cd84-9929-4b20-9cb3-7af13c96cd2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:25.546946 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-26c6cd84-9929-4b20-9cb3-7af13c96cd2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:25.576911 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-e7a390bd-0a75-4113-8ecd-7d3591601c0d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:25.588522 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-e7a390bd-0a75-4113-8ecd-7d3591601c0d tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1502 microversion: 2.1 time: 0.297125 Jan 28 02:03:25.590530 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 174/345] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:25 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:25.610579 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8fd0c121-86bc-4ef0-81d9-a88cf228c52c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:25.611200 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8fd0c121-86bc-4ef0-81d9-a88cf228c52c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:25.618394 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8fd0c121-86bc-4ef0-81d9-a88cf228c52c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:25.619036 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8fd0c121-86bc-4ef0-81d9-a88cf228c52c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:25.620775 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8fd0c121-86bc-4ef0-81d9-a88cf228c52c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:25.621385 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8fd0c121-86bc-4ef0-81d9-a88cf228c52c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:25.731429 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-26c6cd84-9929-4b20-9cb3-7af13c96cd2c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 37608 microversion: 2.20 time: 0.202529 Jan 28 02:03:25.737894 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 172/346] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:25 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 37608 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:03:25.744499 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bb57193a-4b61-4356-b112-44c66bc138c9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:25.746029 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bb57193a-4b61-4356-b112-44c66bc138c9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:25.754295 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bb57193a-4b61-4356-b112-44c66bc138c9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:25.754973 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bb57193a-4b61-4356-b112-44c66bc138c9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:25.755985 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bb57193a-4b61-4356-b112-44c66bc138c9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:25.756669 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bb57193a-4b61-4356-b112-44c66bc138c9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:25.792469 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-bb57193a-4b61-4356-b112-44c66bc138c9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052878 Jan 28 02:03:25.798479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 173/347] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:03:25 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:03:25.916452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8fd0c121-86bc-4ef0-81d9-a88cf228c52c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:25.925882 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8fd0c121-86bc-4ef0-81d9-a88cf228c52c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.322823 Jan 28 02:03:25.926901 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 175/348] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:25 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:26.051434 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-78296147", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "networks": [{"uuid": "a12a014d-4a71-408b-a943-054c73574ed9"}]}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:26.124247 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.network.neutron [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] validate_networks() for [('a12a014d-4a71-408b-a943-054c73574ed9', None, None, None, None, None)] {{(pid=115761) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:03:26.559984 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Flavor limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:03:26.561908 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Image limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:03:26.563417 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Flavor pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:03:26.568691 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Image pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:03:26.569375 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:03:26.581030 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:26.581776 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:26.583508 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:26.584139 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:26.603822 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Getting quotas for project 6639261ee8ee46e0a4e3a01eb63b9ab4. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:03:26.607801 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-57ab6e80-ab58-4b8e-a89f-4dd59e9ff2a1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:26.608364 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Getting quotas for user 9717e2ab2be74631aba4b196112bf984 and project 6639261ee8ee46e0a4e3a01eb63b9ab4. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:03:26.608493 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-57ab6e80-ab58-4b8e-a89f-4dd59e9ff2a1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:26.615651 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-57ab6e80-ab58-4b8e-a89f-4dd59e9ff2a1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:26.616401 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-57ab6e80-ab58-4b8e-a89f-4dd59e9ff2a1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:26.617414 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-57ab6e80-ab58-4b8e-a89f-4dd59e9ff2a1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:26.618088 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-57ab6e80-ab58-4b8e-a89f-4dd59e9ff2a1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:26.619422 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Going to run 1 instances... {{(pid=115761) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:03:26.622004 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:03:26.674663 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d9d0a413-9794-43c8-b50c-69d488c70b4d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627176 Jan 28 02:03:26.675796 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 174/349] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:03:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:03:26.694561 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7affaa45-d92b-49b9-8fa9-4ab3bb9c8521 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:26.695191 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7affaa45-d92b-49b9-8fa9-4ab3bb9c8521 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:26.842348 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-57ab6e80-ab58-4b8e-a89f-4dd59e9ff2a1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:26.844026 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7affaa45-d92b-49b9-8fa9-4ab3bb9c8521 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:26.851559 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7affaa45-d92b-49b9-8fa9-4ab3bb9c8521 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1216 microversion: 2.1 time: 0.169454 Jan 28 02:03:26.852333 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 175/350] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:26 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:26.853489 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-57ab6e80-ab58-4b8e-a89f-4dd59e9ff2a1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1502 microversion: 2.1 time: 0.249270 Jan 28 02:03:26.854593 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 176/351] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:26 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1502 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:26.866538 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8939e37c-a7d8-4cd9-bb36-85a959804397 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:26.867985 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8939e37c-a7d8-4cd9-bb36-85a959804397 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:26.876684 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8939e37c-a7d8-4cd9-bb36-85a959804397 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:26.877929 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8939e37c-a7d8-4cd9-bb36-85a959804397 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:26.879008 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8939e37c-a7d8-4cd9-bb36-85a959804397 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:26.880094 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8939e37c-a7d8-4cd9-bb36-85a959804397 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:26.943674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f1583d0e-7ba6-442b-8645-f56013e07f9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:26.944376 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f1583d0e-7ba6-442b-8645-f56013e07f9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:26.952205 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f1583d0e-7ba6-442b-8645-f56013e07f9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:26.952909 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f1583d0e-7ba6-442b-8645-f56013e07f9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:26.954022 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f1583d0e-7ba6-442b-8645-f56013e07f9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:26.954618 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f1583d0e-7ba6-442b-8645-f56013e07f9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:27.113251 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f1583d0e-7ba6-442b-8645-f56013e07f9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:27.121221 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f1583d0e-7ba6-442b-8645-f56013e07f9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.182336 Jan 28 02:03:27.131923 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 176/352] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:26 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:27.870504 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a3237b7e-4720-4e51-9291-7dff99d19191 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:27.871874 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a3237b7e-4720-4e51-9291-7dff99d19191 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:27.879864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a3237b7e-4720-4e51-9291-7dff99d19191 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:27.880391 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a3237b7e-4720-4e51-9291-7dff99d19191 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:27.881339 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a3237b7e-4720-4e51-9291-7dff99d19191 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:27.881992 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a3237b7e-4720-4e51-9291-7dff99d19191 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:27.961027 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a3237b7e-4720-4e51-9291-7dff99d19191 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:27.968889 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a3237b7e-4720-4e51-9291-7dff99d19191 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1220 microversion: 2.1 time: 0.103945 Jan 28 02:03:27.969930 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 177/353] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:27 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:27.975076 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e4454fd5-4f41-4414-900b-a1d47e491dc0 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:27.976002 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e4454fd5-4f41-4414-900b-a1d47e491dc0 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:27.983223 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4454fd5-4f41-4414-900b-a1d47e491dc0 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:27.983812 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4454fd5-4f41-4414-900b-a1d47e491dc0 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:27.985655 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4454fd5-4f41-4414-900b-a1d47e491dc0 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:27.986329 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4454fd5-4f41-4414-900b-a1d47e491dc0 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:28.143584 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e4454fd5-4f41-4414-900b-a1d47e491dc0 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:28.159108 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e4454fd5-4f41-4414-900b-a1d47e491dc0 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1502 microversion: 2.1 time: 0.187757 Jan 28 02:03:28.160124 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 178/354] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:27 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1502 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:28.165011 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d741a615-2cc1-4b2d-9fa1-b8bb744e71d1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:28.165907 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d741a615-2cc1-4b2d-9fa1-b8bb744e71d1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:28.175592 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d741a615-2cc1-4b2d-9fa1-b8bb744e71d1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:28.176350 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d741a615-2cc1-4b2d-9fa1-b8bb744e71d1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:28.177372 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d741a615-2cc1-4b2d-9fa1-b8bb744e71d1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:28.178030 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d741a615-2cc1-4b2d-9fa1-b8bb744e71d1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:28.322772 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d741a615-2cc1-4b2d-9fa1-b8bb744e71d1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:28.338669 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d741a615-2cc1-4b2d-9fa1-b8bb744e71d1 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.177191 Jan 28 02:03:28.339643 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 179/355] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:28 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:28.993598 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-9db0cd03-8578-4f3d-a50c-80abf7caaf25 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:28.994232 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-9db0cd03-8578-4f3d-a50c-80abf7caaf25 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:29.006978 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9db0cd03-8578-4f3d-a50c-80abf7caaf25 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:29.007667 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9db0cd03-8578-4f3d-a50c-80abf7caaf25 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:29.008781 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9db0cd03-8578-4f3d-a50c-80abf7caaf25 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:29.009179 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9db0cd03-8578-4f3d-a50c-80abf7caaf25 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:29.272396 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8939e37c-a7d8-4cd9-bb36-85a959804397 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 38139 microversion: 2.20 time: 2.416134 Jan 28 02:03:29.274091 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 177/356] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:26 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 38139 bytes in 2419 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:29.280206 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-faef1924-cd4d-413b-b97e-436ad6979870 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:29.281291 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-faef1924-cd4d-413b-b97e-436ad6979870 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:29.288867 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-faef1924-cd4d-413b-b97e-436ad6979870 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:29.289668 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-faef1924-cd4d-413b-b97e-436ad6979870 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:29.290698 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-faef1924-cd4d-413b-b97e-436ad6979870 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:29.291340 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-faef1924-cd4d-413b-b97e-436ad6979870 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:29.396109 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-9db0cd03-8578-4f3d-a50c-80abf7caaf25 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:29.405799 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-9db0cd03-8578-4f3d-a50c-80abf7caaf25 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1220 microversion: 2.1 time: 0.423956 Jan 28 02:03:29.407741 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 180/357] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:28 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1220 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:29.421159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5a6547ac-dbda-4bf3-bc84-f5cc99e23c4b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:29.421784 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-5a6547ac-dbda-4bf3-bc84-f5cc99e23c4b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:29.429228 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5a6547ac-dbda-4bf3-bc84-f5cc99e23c4b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:29.429828 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5a6547ac-dbda-4bf3-bc84-f5cc99e23c4b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:29.431053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5a6547ac-dbda-4bf3-bc84-f5cc99e23c4b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:29.431553 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5a6547ac-dbda-4bf3-bc84-f5cc99e23c4b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:29.789908 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-faef1924-cd4d-413b-b97e-436ad6979870 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:29.798094 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-faef1924-cd4d-413b-b97e-436ad6979870 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1502 microversion: 2.1 time: 0.522280 Jan 28 02:03:29.798770 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 178/358] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:29 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1502 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:29.867296 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-5a6547ac-dbda-4bf3-bc84-f5cc99e23c4b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:29.877673 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-5a6547ac-dbda-4bf3-bc84-f5cc99e23c4b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.468475 Jan 28 02:03:29.878519 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 181/359] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:29 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:30.285782 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-730a7fad-6f58-4dfe-8741-67b04c4b84fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:30.286706 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-730a7fad-6f58-4dfe-8741-67b04c4b84fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:30.300156 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-730a7fad-6f58-4dfe-8741-67b04c4b84fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:30.300613 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-730a7fad-6f58-4dfe-8741-67b04c4b84fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:30.301436 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-730a7fad-6f58-4dfe-8741-67b04c4b84fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:30.301895 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-730a7fad-6f58-4dfe-8741-67b04c4b84fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:30.430909 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8d75a7a1-f1bb-43c5-a7a0-cfba4c3cb4b9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:30.431893 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8d75a7a1-f1bb-43c5-a7a0-cfba4c3cb4b9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:30.442355 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-730a7fad-6f58-4dfe-8741-67b04c4b84fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 38159 microversion: 2.20 time: 0.159926 Jan 28 02:03:30.443155 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 179/360] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:30 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 38159 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:30.448736 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d75a7a1-f1bb-43c5-a7a0-cfba4c3cb4b9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:30.454701 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d75a7a1-f1bb-43c5-a7a0-cfba4c3cb4b9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:30.459791 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d75a7a1-f1bb-43c5-a7a0-cfba4c3cb4b9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:30.460262 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d75a7a1-f1bb-43c5-a7a0-cfba4c3cb4b9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:30.590452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-70d4cb15-87f9-4696-bb29-fdb7414e3b56 req-47ca5943-b92b-42bd-b684-51271c500816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb6e346f-7608-43e4-a218-aaef2e657f0f", "name": "network-vif-deleted", "tag": "74f004ac-1a79-4bd1-be0e-04fb236b29f4"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:30.591770 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:30.591770 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:03:30.611665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-70d4cb15-87f9-4696-bb29-fdb7414e3b56 req-47ca5943-b92b-42bd-b684-51271c500816 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:30.612038 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-70d4cb15-87f9-4696-bb29-fdb7414e3b56 req-47ca5943-b92b-42bd-b684-51271c500816 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:30.626084 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8d75a7a1-f1bb-43c5-a7a0-cfba4c3cb4b9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:30.637935 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8d75a7a1-f1bb-43c5-a7a0-cfba4c3cb4b9 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1274 microversion: 2.1 time: 0.217093 Jan 28 02:03:30.641913 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 182/361] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:30 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1274 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:30.645112 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-70d4cb15-87f9-4696-bb29-fdb7414e3b56 req-47ca5943-b92b-42bd-b684-51271c500816 service nova] Creating event network-vif-deleted:74f004ac-1a79-4bd1-be0e-04fb236b29f4 for instance cb6e346f-7608-43e4-a218-aaef2e657f0f on hv-cinder-82497 Jan 28 02:03:30.650432 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-70d4cb15-87f9-4696-bb29-fdb7414e3b56 req-47ca5943-b92b-42bd-b684-51271c500816 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065320 Jan 28 02:03:30.651603 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 180/362] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:30.820213 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2b324279-1859-45f7-b4c5-714cae4fbd4a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:30.820213 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-2b324279-1859-45f7-b4c5-714cae4fbd4a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:30.823394 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b324279-1859-45f7-b4c5-714cae4fbd4a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:30.823839 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b324279-1859-45f7-b4c5-714cae4fbd4a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:30.824721 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b324279-1859-45f7-b4c5-714cae4fbd4a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:30.825203 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b324279-1859-45f7-b4c5-714cae4fbd4a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:30.858916 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b324279-1859-45f7-b4c5-714cae4fbd4a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:30.859365 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b324279-1859-45f7-b4c5-714cae4fbd4a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:30.860021 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-2b324279-1859-45f7-b4c5-714cae4fbd4a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lazy-loading 'fault' on Instance uuid cb6e346f-7608-43e4-a218-aaef2e657f0f {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:03:30.896392 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-47ff2117-3e2e-4ea8-82ea-6a51ad7ac4c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:30.897228 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-47ff2117-3e2e-4ea8-82ea-6a51ad7ac4c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:30.904982 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-47ff2117-3e2e-4ea8-82ea-6a51ad7ac4c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:30.905892 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-47ff2117-3e2e-4ea8-82ea-6a51ad7ac4c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:30.907050 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-47ff2117-3e2e-4ea8-82ea-6a51ad7ac4c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:30.907641 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-47ff2117-3e2e-4ea8-82ea-6a51ad7ac4c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:30.908733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-2b324279-1859-45f7-b4c5-714cae4fbd4a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:30.917332 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2b324279-1859-45f7-b4c5-714cae4fbd4a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 200 len: 1303 microversion: 2.1 time: 0.104388 Jan 28 02:03:30.918020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 183/363] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:30 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:31.115372 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-47ff2117-3e2e-4ea8-82ea-6a51ad7ac4c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:31.125831 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-47ff2117-3e2e-4ea8-82ea-6a51ad7ac4c3 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1501 microversion: 2.1 time: 0.234540 Jan 28 02:03:31.145414 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-90ef5568-26a3-4a88-9c2b-716f74b32476 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5ed77c6-ac97-4300-ace2-7c31ce403c9f"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:31.151408 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 181/364] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:30 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1501 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:31.159367 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-90ef5568-26a3-4a88-9c2b-716f74b32476 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:31.166194 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-90ef5568-26a3-4a88-9c2b-716f74b32476 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.166641 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-90ef5568-26a3-4a88-9c2b-716f74b32476 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.167422 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-90ef5568-26a3-4a88-9c2b-716f74b32476 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.168118 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-90ef5568-26a3-4a88-9c2b-716f74b32476 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.234811 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-90ef5568-26a3-4a88-9c2b-716f74b32476 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] HTTP exception thrown: Cannot 'attach_volume' instance 706d03a1-cf66-4cdb-8271-bb94ca669ad7 while it is in vm_state rescued Jan 28 02:03:31.235732 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-90ef5568-26a3-4a88-9c2b-716f74b32476 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Returning 409 to user: Cannot 'attach_volume' instance 706d03a1-cf66-4cdb-8271-bb94ca669ad7 while it is in vm_state rescued {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:03:31.236955 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-90ef5568-26a3-4a88-9c2b-716f74b32476 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "POST /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.097094 Jan 28 02:03:31.242334 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 184/365] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:03:31 2022] POST /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/os-volume_attachments => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 02:03:31.265905 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-73b7d235-c6ad-4c53-8d0f-1c3ba33cf592 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:31.266863 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-73b7d235-c6ad-4c53-8d0f-1c3ba33cf592 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:31.283215 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-73b7d235-c6ad-4c53-8d0f-1c3ba33cf592 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.283902 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-73b7d235-c6ad-4c53-8d0f-1c3ba33cf592 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.286533 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-73b7d235-c6ad-4c53-8d0f-1c3ba33cf592 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.288111 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-73b7d235-c6ad-4c53-8d0f-1c3ba33cf592 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.431576 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-73b7d235-c6ad-4c53-8d0f-1c3ba33cf592 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "POST /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/action" status: 202 len: 0 microversion: 2.1 time: 0.188023 Jan 28 02:03:31.435223 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 182/366] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:03:31 2022] POST /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:31.445502 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-aa975ada-ce2d-46c7-9ae5-cfd339438d31 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:31.448009 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-aa975ada-ce2d-46c7-9ae5-cfd339438d31 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:31.459646 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aa975ada-ce2d-46c7-9ae5-cfd339438d31 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.461335 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aa975ada-ce2d-46c7-9ae5-cfd339438d31 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.463259 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aa975ada-ce2d-46c7-9ae5-cfd339438d31 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.464004 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aa975ada-ce2d-46c7-9ae5-cfd339438d31 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.465880 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-fb24db30-ad31-4aa0-8071-a5db08d499cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:31.467657 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-fb24db30-ad31-4aa0-8071-a5db08d499cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:31.477666 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fb24db30-ad31-4aa0-8071-a5db08d499cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.479297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fb24db30-ad31-4aa0-8071-a5db08d499cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.481715 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fb24db30-ad31-4aa0-8071-a5db08d499cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.483476 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fb24db30-ad31-4aa0-8071-a5db08d499cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.613405 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-fb24db30-ad31-4aa0-8071-a5db08d499cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 200 len: 38279 microversion: 2.20 time: 0.161995 Jan 28 02:03:31.618405 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 183/367] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:31 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 38279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:31.629634 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f68080a0-f9e5-426a-b219-f2e0c385a717 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:31.630269 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f68080a0-f9e5-426a-b219-f2e0c385a717 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:31.638255 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f68080a0-f9e5-426a-b219-f2e0c385a717 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.639529 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f68080a0-f9e5-426a-b219-f2e0c385a717 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.640756 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f68080a0-f9e5-426a-b219-f2e0c385a717 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.641640 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f68080a0-f9e5-426a-b219-f2e0c385a717 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.673656 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f68080a0-f9e5-426a-b219-f2e0c385a717 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/ips" status: 200 len: 152 microversion: 2.20 time: 0.047952 Jan 28 02:03:31.680006 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-aa975ada-ce2d-46c7-9ae5-cfd339438d31 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:31.688817 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-aa975ada-ce2d-46c7-9ae5-cfd339438d31 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1509 microversion: 2.1 time: 0.251738 Jan 28 02:03:31.689555 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 185/368] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:31 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1509 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:31.699073 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 184/369] 10.222.0.77 () {60 vars in 1288 bytes} [Fri Jan 28 02:03:31 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/ips => generated 152 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:03:31.714538 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-13f34e3d-ec76-4c63-ba2e-af6ca7b4483e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:31.715226 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-13f34e3d-ec76-4c63-ba2e-af6ca7b4483e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:31.733477 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-13f34e3d-ec76-4c63-ba2e-af6ca7b4483e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.733959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-13f34e3d-ec76-4c63-ba2e-af6ca7b4483e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.734816 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-13f34e3d-ec76-4c63-ba2e-af6ca7b4483e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.735266 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-13f34e3d-ec76-4c63-ba2e-af6ca7b4483e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.911875 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-13f34e3d-ec76-4c63-ba2e-af6ca7b4483e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:31.931216 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-13f34e3d-ec76-4c63-ba2e-af6ca7b4483e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1274 microversion: 2.1 time: 0.227550 Jan 28 02:03:31.940113 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-518ce817-50aa-45e5-85cb-ac577d5d089b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:31.941222 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-518ce817-50aa-45e5-85cb-ac577d5d089b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: cb6e346f-7608-43e4-a218-aaef2e657f0f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:31.944216 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 186/370] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:31 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1274 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:31.957430 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-518ce817-50aa-45e5-85cb-ac577d5d089b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.958029 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-518ce817-50aa-45e5-85cb-ac577d5d089b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.958934 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-518ce817-50aa-45e5-85cb-ac577d5d089b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.959536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-518ce817-50aa-45e5-85cb-ac577d5d089b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.984126 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-518ce817-50aa-45e5-85cb-ac577d5d089b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] HTTP exception thrown: Instance cb6e346f-7608-43e4-a218-aaef2e657f0f could not be found. Jan 28 02:03:31.985315 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-518ce817-50aa-45e5-85cb-ac577d5d089b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Returning 404 to user: Instance cb6e346f-7608-43e4-a218-aaef2e657f0f could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:03:31.986962 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-518ce817-50aa-45e5-85cb-ac577d5d089b tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f" status: 404 len: 111 microversion: 2.1 time: 0.053820 Jan 28 02:03:31.991883 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 185/371] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:31 2022] GET /compute/v2.1/servers/cb6e346f-7608-43e4-a218-aaef2e657f0f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:03:32.148806 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1047584691", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "networks": [{"uuid": "03f0791d-b3f7-4442-a4cf-e0612c275e41"}]}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:32.263424 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.network.neutron [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] validate_networks() for [('03f0791d-b3f7-4442-a4cf-e0612c275e41', None, None, None, None, None)] {{(pid=115761) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:03:32.706685 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1352ad23-ffb5-4e39-9534-21af916ac3c5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:32.708787 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1352ad23-ffb5-4e39-9534-21af916ac3c5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:32.716215 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1352ad23-ffb5-4e39-9534-21af916ac3c5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:32.717672 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1352ad23-ffb5-4e39-9534-21af916ac3c5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:32.718964 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1352ad23-ffb5-4e39-9534-21af916ac3c5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:32.720216 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1352ad23-ffb5-4e39-9534-21af916ac3c5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:32.949994 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Flavor limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:03:32.954042 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Image limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:03:32.954964 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Flavor pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:03:32.955580 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Image pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:03:32.956588 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:03:32.976549 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:32.977270 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:32.978361 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:32.979589 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:32.984463 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-1352ad23-ffb5-4e39-9534-21af916ac3c5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:33.007837 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1352ad23-ffb5-4e39-9534-21af916ac3c5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1509 microversion: 2.1 time: 0.304879 Jan 28 02:03:33.027129 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 186/372] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:32 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1509 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:33.036762 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-75ec6bd8-660e-4bf7-9001-4902ed9ef244 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:33.037396 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-75ec6bd8-660e-4bf7-9001-4902ed9ef244 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:33.052639 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-75ec6bd8-660e-4bf7-9001-4902ed9ef244 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:33.053518 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-75ec6bd8-660e-4bf7-9001-4902ed9ef244 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:33.054790 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-75ec6bd8-660e-4bf7-9001-4902ed9ef244 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:33.057501 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-75ec6bd8-660e-4bf7-9001-4902ed9ef244 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:33.057675 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Getting quotas for project db6ea7ebf03d4ba89b2158cb1610b391. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:03:33.091284 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Getting quotas for user 1f85e8545e634ff99938a4c9dfa1bd2c and project db6ea7ebf03d4ba89b2158cb1610b391. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:03:33.115160 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Going to run 1 instances... {{(pid=115761) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:03:33.117918 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:03:33.195580 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-46aae554-739d-47c5-8c72-0ed95beec4e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050514 Jan 28 02:03:33.196839 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 187/373] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:03:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 02:03:33.226826 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-77ca2855-33fa-4988-b0be-3cd895f1c8cf tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:33.234187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-77ca2855-33fa-4988-b0be-3cd895f1c8cf tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:33.399479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-77ca2855-33fa-4988-b0be-3cd895f1c8cf tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:33.407392 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-77ca2855-33fa-4988-b0be-3cd895f1c8cf tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1214 microversion: 2.1 time: 0.200391 Jan 28 02:03:33.407955 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 188/374] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:33 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1214 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:33.452737 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-75ec6bd8-660e-4bf7-9001-4902ed9ef244 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:33.473876 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-75ec6bd8-660e-4bf7-9001-4902ed9ef244 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 0.447435 Jan 28 02:03:33.511409 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 187/375] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:33 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:34.032930 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-296c28ab-bf42-40ea-ae3c-9fba6bf5dc00 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:34.033555 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-296c28ab-bf42-40ea-ae3c-9fba6bf5dc00 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:34.045348 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-296c28ab-bf42-40ea-ae3c-9fba6bf5dc00 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:34.045925 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-296c28ab-bf42-40ea-ae3c-9fba6bf5dc00 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:34.046897 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-296c28ab-bf42-40ea-ae3c-9fba6bf5dc00 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:34.047683 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-296c28ab-bf42-40ea-ae3c-9fba6bf5dc00 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:34.238764 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-296c28ab-bf42-40ea-ae3c-9fba6bf5dc00 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:34.252002 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-296c28ab-bf42-40ea-ae3c-9fba6bf5dc00 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1509 microversion: 2.1 time: 0.222808 Jan 28 02:03:34.258472 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 189/376] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:34 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:34.422975 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ceb705c0-97ac-40db-9353-4f819c96ed7d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:34.423407 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ceb705c0-97ac-40db-9353-4f819c96ed7d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:34.430534 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-364a1837-ab91-458b-be19-51a981850a6c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:34.431164 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-364a1837-ab91-458b-be19-51a981850a6c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:34.437583 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ceb705c0-97ac-40db-9353-4f819c96ed7d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:34.439625 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-364a1837-ab91-458b-be19-51a981850a6c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:34.442818 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ceb705c0-97ac-40db-9353-4f819c96ed7d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:34.443528 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-364a1837-ab91-458b-be19-51a981850a6c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:34.444524 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-364a1837-ab91-458b-be19-51a981850a6c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:34.445805 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-364a1837-ab91-458b-be19-51a981850a6c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:34.446112 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ceb705c0-97ac-40db-9353-4f819c96ed7d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:34.446588 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ceb705c0-97ac-40db-9353-4f819c96ed7d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:34.480457 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.objects.instance [None req-ceb705c0-97ac-40db-9353-4f819c96ed7d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lazy-loading 'flavor' on Instance uuid 9d048580-813a-43b7-ae1a-e0b1a9c8c234 {{(pid=115760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:03:34.573650 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-364a1837-ab91-458b-be19-51a981850a6c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:34.586004 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-364a1837-ab91-458b-be19-51a981850a6c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1266 microversion: 2.1 time: 0.158927 Jan 28 02:03:34.586584 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 190/377] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:34 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:34.593565 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5ea0edec-273d-4fec-b26d-4f52b1bb3597 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:34.594118 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-5ea0edec-273d-4fec-b26d-4f52b1bb3597 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:34.610631 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5ea0edec-273d-4fec-b26d-4f52b1bb3597 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:34.611340 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5ea0edec-273d-4fec-b26d-4f52b1bb3597 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:34.612346 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5ea0edec-273d-4fec-b26d-4f52b1bb3597 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:34.612948 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5ea0edec-273d-4fec-b26d-4f52b1bb3597 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:34.975376 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ceb705c0-97ac-40db-9353-4f819c96ed7d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 202 len: 0 microversion: 2.20 time: 0.555446 Jan 28 02:03:34.977475 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 188/378] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:34 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:03:34.989009 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-fd04e478-031b-455a-83f6-15779105d269 req-99fd40fd-ee24-4f38-a1a5-68e8286c8f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba343337-b8f3-4f63-875e-c13b7711e8bf", "tag": "c105129e-5873-411f-b8e0-8fa24f669b60"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:34.993714 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:34.993714 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:03:35.019887 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-fd04e478-031b-455a-83f6-15779105d269 req-99fd40fd-ee24-4f38-a1a5-68e8286c8f80 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:35.022969 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-fd04e478-031b-455a-83f6-15779105d269 req-99fd40fd-ee24-4f38-a1a5-68e8286c8f80 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:35.062737 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-fd04e478-031b-455a-83f6-15779105d269 req-99fd40fd-ee24-4f38-a1a5-68e8286c8f80 service nova] Creating event network-changed:c105129e-5873-411f-b8e0-8fa24f669b60 for instance ba343337-b8f3-4f63-875e-c13b7711e8bf on hv-cinder-82497 Jan 28 02:03:35.099201 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-fd04e478-031b-455a-83f6-15779105d269 req-99fd40fd-ee24-4f38-a1a5-68e8286c8f80 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117434 Jan 28 02:03:35.103798 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 189/379] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:35.131318 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7fd108b5-7712-4c04-b860-c61155f0571b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:35.132196 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7fd108b5-7712-4c04-b860-c61155f0571b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:35.156665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7fd108b5-7712-4c04-b860-c61155f0571b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:35.157114 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7fd108b5-7712-4c04-b860-c61155f0571b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:35.157978 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7fd108b5-7712-4c04-b860-c61155f0571b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:35.165437 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7fd108b5-7712-4c04-b860-c61155f0571b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:35.824804 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-5ea0edec-273d-4fec-b26d-4f52b1bb3597 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:35.834138 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-5ea0edec-273d-4fec-b26d-4f52b1bb3597 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 1.246514 Jan 28 02:03:35.837695 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 191/380] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:34 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:35.851452 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-64ef8460-a51a-4591-b33e-ef9365e88135 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:35.852219 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-64ef8460-a51a-4591-b33e-ef9365e88135 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:35.876856 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-64ef8460-a51a-4591-b33e-ef9365e88135 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:35.877301 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-64ef8460-a51a-4591-b33e-ef9365e88135 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:35.878272 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-64ef8460-a51a-4591-b33e-ef9365e88135 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:35.878717 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-64ef8460-a51a-4591-b33e-ef9365e88135 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:36.111749 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7fd108b5-7712-4c04-b860-c61155f0571b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:36.124890 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7fd108b5-7712-4c04-b860-c61155f0571b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:36.127800 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7fd108b5-7712-4c04-b860-c61155f0571b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:36.129444 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7fd108b5-7712-4c04-b860-c61155f0571b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 1.023191 Jan 28 02:03:36.130664 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 190/381] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:35 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:36.136185 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-029cb00f-dae8-400d-a818-da84b827d50e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:36.137224 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-029cb00f-dae8-400d-a818-da84b827d50e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:36.143864 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-029cb00f-dae8-400d-a818-da84b827d50e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:36.144508 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-029cb00f-dae8-400d-a818-da84b827d50e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:36.145306 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-029cb00f-dae8-400d-a818-da84b827d50e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:36.145733 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-029cb00f-dae8-400d-a818-da84b827d50e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:36.273047 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-029cb00f-dae8-400d-a818-da84b827d50e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:36.282130 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-029cb00f-dae8-400d-a818-da84b827d50e tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1272 microversion: 2.1 time: 0.149992 Jan 28 02:03:36.291915 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 191/382] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:36 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:36.338133 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-64ef8460-a51a-4591-b33e-ef9365e88135 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:36.343378 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-64ef8460-a51a-4591-b33e-ef9365e88135 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1515 microversion: 2.1 time: 0.503232 Jan 28 02:03:36.344461 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 192/383] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:35 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1515 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:36.854918 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-35654379-35bf-44a1-ba47-9ba1c8fd49f5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:36.855601 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-35654379-35bf-44a1-ba47-9ba1c8fd49f5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:36.864376 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-35654379-35bf-44a1-ba47-9ba1c8fd49f5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:36.864823 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-35654379-35bf-44a1-ba47-9ba1c8fd49f5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:36.866819 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-35654379-35bf-44a1-ba47-9ba1c8fd49f5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:36.870959 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-35654379-35bf-44a1-ba47-9ba1c8fd49f5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:37.148678 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1275d499-ee12-4b4c-ac32-d4451b4a7cf9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:37.149281 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1275d499-ee12-4b4c-ac32-d4451b4a7cf9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:37.163809 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1275d499-ee12-4b4c-ac32-d4451b4a7cf9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:37.164239 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1275d499-ee12-4b4c-ac32-d4451b4a7cf9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:37.165107 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1275d499-ee12-4b4c-ac32-d4451b4a7cf9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:37.165537 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1275d499-ee12-4b4c-ac32-d4451b4a7cf9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:37.378452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-35654379-35bf-44a1-ba47-9ba1c8fd49f5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:37.391755 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-35654379-35bf-44a1-ba47-9ba1c8fd49f5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 0.540680 Jan 28 02:03:37.393071 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 192/384] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:36 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:37.398613 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4cc0aa54-ca9e-4782-90e5-e0ac072d05c4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:37.399533 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4cc0aa54-ca9e-4782-90e5-e0ac072d05c4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:37.408998 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4cc0aa54-ca9e-4782-90e5-e0ac072d05c4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:37.409581 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4cc0aa54-ca9e-4782-90e5-e0ac072d05c4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:37.410690 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4cc0aa54-ca9e-4782-90e5-e0ac072d05c4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:37.411222 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4cc0aa54-ca9e-4782-90e5-e0ac072d05c4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:37.677931 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1275d499-ee12-4b4c-ac32-d4451b4a7cf9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:37.690720 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1275d499-ee12-4b4c-ac32-d4451b4a7cf9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:37.692462 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1275d499-ee12-4b4c-ac32-d4451b4a7cf9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:37.694785 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1275d499-ee12-4b4c-ac32-d4451b4a7cf9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 0.550400 Jan 28 02:03:37.695903 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 193/385] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:37 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:37.708479 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4cc0aa54-ca9e-4782-90e5-e0ac072d05c4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:37.717194 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4cc0aa54-ca9e-4782-90e5-e0ac072d05c4 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.322804 Jan 28 02:03:37.718318 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 193/386] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:37 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:38.409158 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d2b91b5c-bb6c-4311-8a0c-d6869e6b4143 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:38.410314 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d2b91b5c-bb6c-4311-8a0c-d6869e6b4143 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:38.417032 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d2b91b5c-bb6c-4311-8a0c-d6869e6b4143 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:38.417684 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d2b91b5c-bb6c-4311-8a0c-d6869e6b4143 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:38.418678 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d2b91b5c-bb6c-4311-8a0c-d6869e6b4143 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:38.420237 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d2b91b5c-bb6c-4311-8a0c-d6869e6b4143 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:38.617838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d2b91b5c-bb6c-4311-8a0c-d6869e6b4143 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:38.628092 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d2b91b5c-bb6c-4311-8a0c-d6869e6b4143 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 0.223346 Jan 28 02:03:38.628685 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 194/387] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:38 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:38.715739 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8ecbf666-7dc7-4ed4-b3ab-7ccedcda1576 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:38.716350 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8ecbf666-7dc7-4ed4-b3ab-7ccedcda1576 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:38.735284 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-686bb265-8d12-47c7-88c0-12918ff13093 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:38.735906 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-686bb265-8d12-47c7-88c0-12918ff13093 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:38.752889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8ecbf666-7dc7-4ed4-b3ab-7ccedcda1576 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:38.753436 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8ecbf666-7dc7-4ed4-b3ab-7ccedcda1576 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:38.761051 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8ecbf666-7dc7-4ed4-b3ab-7ccedcda1576 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:38.761570 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8ecbf666-7dc7-4ed4-b3ab-7ccedcda1576 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:38.772479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-686bb265-8d12-47c7-88c0-12918ff13093 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:38.772935 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-686bb265-8d12-47c7-88c0-12918ff13093 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:38.774191 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-686bb265-8d12-47c7-88c0-12918ff13093 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:38.774325 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-686bb265-8d12-47c7-88c0-12918ff13093 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:39.252531 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8ecbf666-7dc7-4ed4-b3ab-7ccedcda1576 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:39.266162 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8ecbf666-7dc7-4ed4-b3ab-7ccedcda1576 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:39.268375 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8ecbf666-7dc7-4ed4-b3ab-7ccedcda1576 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:39.269935 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8ecbf666-7dc7-4ed4-b3ab-7ccedcda1576 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 0.558630 Jan 28 02:03:39.271841 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 194/388] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:38 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:39.285922 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-686bb265-8d12-47c7-88c0-12918ff13093 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:39.303777 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-686bb265-8d12-47c7-88c0-12918ff13093 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.573148 Jan 28 02:03:39.318228 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 195/389] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:38 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:39.649224 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5ad25f66-06a2-4917-bf32-bbea79c0e21d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:39.650360 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5ad25f66-06a2-4917-bf32-bbea79c0e21d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:39.657533 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5ad25f66-06a2-4917-bf32-bbea79c0e21d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:39.658233 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5ad25f66-06a2-4917-bf32-bbea79c0e21d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:39.659198 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5ad25f66-06a2-4917-bf32-bbea79c0e21d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:39.659780 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5ad25f66-06a2-4917-bf32-bbea79c0e21d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:40.034416 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-18526a42-82a9-4c6c-a013-fed9f033eec8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:40.035649 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-18526a42-82a9-4c6c-a013-fed9f033eec8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:40.047539 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-18526a42-82a9-4c6c-a013-fed9f033eec8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:40.048680 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-18526a42-82a9-4c6c-a013-fed9f033eec8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:40.050885 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-18526a42-82a9-4c6c-a013-fed9f033eec8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:40.051895 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-18526a42-82a9-4c6c-a013-fed9f033eec8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:40.653286 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5ad25f66-06a2-4917-bf32-bbea79c0e21d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:40.678770 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5ad25f66-06a2-4917-bf32-bbea79c0e21d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 1.031054 Jan 28 02:03:40.695087 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 195/390] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:39 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:40.708236 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-71670e7f-d491-493c-b71e-69487dbd02f3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:40.709046 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-71670e7f-d491-493c-b71e-69487dbd02f3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:40.722899 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-71670e7f-d491-493c-b71e-69487dbd02f3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:40.723634 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-71670e7f-d491-493c-b71e-69487dbd02f3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:40.724745 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-71670e7f-d491-493c-b71e-69487dbd02f3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:40.726717 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-71670e7f-d491-493c-b71e-69487dbd02f3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:41.292007 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-18526a42-82a9-4c6c-a013-fed9f033eec8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:41.308220 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-18526a42-82a9-4c6c-a013-fed9f033eec8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1515 microversion: 2.1 time: 1.279519 Jan 28 02:03:41.312007 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 196/391] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:40 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1515 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:41.324775 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-01f2db8f-354d-453b-b7c2-88a906570e8c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:41.325393 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-01f2db8f-354d-453b-b7c2-88a906570e8c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:41.340662 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-01f2db8f-354d-453b-b7c2-88a906570e8c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:41.343736 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-01f2db8f-354d-453b-b7c2-88a906570e8c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:41.348694 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-01f2db8f-354d-453b-b7c2-88a906570e8c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:41.351382 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-01f2db8f-354d-453b-b7c2-88a906570e8c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:41.474309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-71670e7f-d491-493c-b71e-69487dbd02f3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:41.498546 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-71670e7f-d491-493c-b71e-69487dbd02f3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:41.502954 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-71670e7f-d491-493c-b71e-69487dbd02f3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:41.518885 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-71670e7f-d491-493c-b71e-69487dbd02f3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 0.811949 Jan 28 02:03:41.530609 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 196/392] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:40 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:41.543209 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-9ea2cc90-faac-463f-9179-f1226d20f5a3 req-90c65000-1c0b-48ec-b79b-f55ac69bd41f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71af6d79-02c9-49a6-b39a-e9ff65a92bdd", "tag": "fa7d8f86-0dd8-42bc-8bab-c8aebe6a1fdb"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:41.545729 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:41.545729 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:03:41.555335 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-9ea2cc90-faac-463f-9179-f1226d20f5a3 req-90c65000-1c0b-48ec-b79b-f55ac69bd41f service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:41.556246 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-9ea2cc90-faac-463f-9179-f1226d20f5a3 req-90c65000-1c0b-48ec-b79b-f55ac69bd41f service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:41.586760 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-9ea2cc90-faac-463f-9179-f1226d20f5a3 req-90c65000-1c0b-48ec-b79b-f55ac69bd41f service nova] Creating event network-changed:fa7d8f86-0dd8-42bc-8bab-c8aebe6a1fdb for instance 71af6d79-02c9-49a6-b39a-e9ff65a92bdd on hv-cinder-82497 Jan 28 02:03:41.597236 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-9ea2cc90-faac-463f-9179-f1226d20f5a3 req-90c65000-1c0b-48ec-b79b-f55ac69bd41f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061609 Jan 28 02:03:41.598194 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 197/393] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:41.620077 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-215ff7f9-497e-49ee-85c1-65d4b74b0273 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d31382bb-997b-4e95-9e68-aea8679d4263"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:41.621513 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-215ff7f9-497e-49ee-85c1-65d4b74b0273 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:41.633587 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-215ff7f9-497e-49ee-85c1-65d4b74b0273 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:41.634070 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-215ff7f9-497e-49ee-85c1-65d4b74b0273 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:41.635238 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-215ff7f9-497e-49ee-85c1-65d4b74b0273 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:41.635735 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-215ff7f9-497e-49ee-85c1-65d4b74b0273 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:41.699320 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-01f2db8f-354d-453b-b7c2-88a906570e8c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:41.710453 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-01f2db8f-354d-453b-b7c2-88a906570e8c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.397110 Jan 28 02:03:41.711020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 197/394] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:41 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:41.723172 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-55ae3d03-fb60-4263-b5c6-8a7f009aa63d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:41.723754 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-55ae3d03-fb60-4263-b5c6-8a7f009aa63d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:41.738067 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-55ae3d03-fb60-4263-b5c6-8a7f009aa63d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:41.739296 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-55ae3d03-fb60-4263-b5c6-8a7f009aa63d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:41.740245 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-55ae3d03-fb60-4263-b5c6-8a7f009aa63d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:41.740856 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-55ae3d03-fb60-4263-b5c6-8a7f009aa63d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:42.042224 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-55ae3d03-fb60-4263-b5c6-8a7f009aa63d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:42.052236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-55ae3d03-fb60-4263-b5c6-8a7f009aa63d tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 0.332798 Jan 28 02:03:42.053942 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 198/395] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:41 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:42.121290 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-215ff7f9-497e-49ee-85c1-65d4b74b0273 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "POST /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.520777 Jan 28 02:03:42.122815 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 198/396] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:03:41 2022] POST /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/os-volume_attachments => generated 194 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:42.544124 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-973cad6b-08fe-4b61-bdf5-c51a9eb25312 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:42.545898 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-973cad6b-08fe-4b61-bdf5-c51a9eb25312 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:42.562467 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-973cad6b-08fe-4b61-bdf5-c51a9eb25312 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:42.563599 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-973cad6b-08fe-4b61-bdf5-c51a9eb25312 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:42.564598 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-973cad6b-08fe-4b61-bdf5-c51a9eb25312 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:42.566357 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-973cad6b-08fe-4b61-bdf5-c51a9eb25312 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:42.731900 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ed89037d-4af0-48d8-a96f-46d0e78ba58a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:42.735833 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ed89037d-4af0-48d8-a96f-46d0e78ba58a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:42.758883 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ed89037d-4af0-48d8-a96f-46d0e78ba58a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:42.759374 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ed89037d-4af0-48d8-a96f-46d0e78ba58a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:42.760202 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ed89037d-4af0-48d8-a96f-46d0e78ba58a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:42.769297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ed89037d-4af0-48d8-a96f-46d0e78ba58a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:42.966615 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-973cad6b-08fe-4b61-bdf5-c51a9eb25312 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:42.989153 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-973cad6b-08fe-4b61-bdf5-c51a9eb25312 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:43.003214 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-973cad6b-08fe-4b61-bdf5-c51a9eb25312 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:43.004594 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-973cad6b-08fe-4b61-bdf5-c51a9eb25312 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 0.464143 Jan 28 02:03:43.012535 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 199/397] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:42 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:43.071196 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0dd24811-cd0e-41c9-82f2-c755b589afda tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:43.073580 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0dd24811-cd0e-41c9-82f2-c755b589afda tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:43.102613 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0dd24811-cd0e-41c9-82f2-c755b589afda tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:43.103331 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0dd24811-cd0e-41c9-82f2-c755b589afda tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:43.104553 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0dd24811-cd0e-41c9-82f2-c755b589afda tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:43.105936 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0dd24811-cd0e-41c9-82f2-c755b589afda tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:43.322400 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ed89037d-4af0-48d8-a96f-46d0e78ba58a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:43.336692 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ed89037d-4af0-48d8-a96f-46d0e78ba58a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.609564 Jan 28 02:03:43.337470 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 199/398] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:42 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:43.483137 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0dd24811-cd0e-41c9-82f2-c755b589afda tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:43.493152 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0dd24811-cd0e-41c9-82f2-c755b589afda tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 0.425932 Jan 28 02:03:43.494166 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 200/399] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:43 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:44.026994 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6e5a731a-d019-48c1-98bb-e67e7887db82 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:44.027604 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6e5a731a-d019-48c1-98bb-e67e7887db82 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:44.034050 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6e5a731a-d019-48c1-98bb-e67e7887db82 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:44.034714 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6e5a731a-d019-48c1-98bb-e67e7887db82 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:44.035619 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6e5a731a-d019-48c1-98bb-e67e7887db82 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:44.036049 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6e5a731a-d019-48c1-98bb-e67e7887db82 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:44.259868 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6e5a731a-d019-48c1-98bb-e67e7887db82 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:44.280656 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6e5a731a-d019-48c1-98bb-e67e7887db82 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:44.284399 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6e5a731a-d019-48c1-98bb-e67e7887db82 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:44.285677 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6e5a731a-d019-48c1-98bb-e67e7887db82 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 0.262387 Jan 28 02:03:44.286346 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 200/400] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:44 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:44.364191 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e713ddf1-e980-44e9-88dc-84622334deec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:44.371815 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e713ddf1-e980-44e9-88dc-84622334deec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:44.423299 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e713ddf1-e980-44e9-88dc-84622334deec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:44.427264 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e713ddf1-e980-44e9-88dc-84622334deec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:44.428888 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e713ddf1-e980-44e9-88dc-84622334deec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:44.432303 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e713ddf1-e980-44e9-88dc-84622334deec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:44.510340 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-53c9e6dc-cfe5-409a-9245-71363bcd14c3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:44.511272 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-53c9e6dc-cfe5-409a-9245-71363bcd14c3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:44.531676 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-53c9e6dc-cfe5-409a-9245-71363bcd14c3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:44.532270 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-53c9e6dc-cfe5-409a-9245-71363bcd14c3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:44.533483 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-53c9e6dc-cfe5-409a-9245-71363bcd14c3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:44.534179 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-53c9e6dc-cfe5-409a-9245-71363bcd14c3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:44.675293 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e713ddf1-e980-44e9-88dc-84622334deec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:44.686344 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e713ddf1-e980-44e9-88dc-84622334deec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.334858 Jan 28 02:03:44.687200 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 201/401] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:44 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:44.799743 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-53c9e6dc-cfe5-409a-9245-71363bcd14c3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:44.827541 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-53c9e6dc-cfe5-409a-9245-71363bcd14c3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 0.320771 Jan 28 02:03:44.829029 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 201/402] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:44 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:45.307790 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-92c71a46-6fbf-4749-ac1f-3c34d3286e56 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:45.308403 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-92c71a46-6fbf-4749-ac1f-3c34d3286e56 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:45.317065 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-92c71a46-6fbf-4749-ac1f-3c34d3286e56 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:45.317512 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-92c71a46-6fbf-4749-ac1f-3c34d3286e56 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:45.326743 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-92c71a46-6fbf-4749-ac1f-3c34d3286e56 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:45.328549 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-92c71a46-6fbf-4749-ac1f-3c34d3286e56 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:45.528486 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-92c71a46-6fbf-4749-ac1f-3c34d3286e56 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:45.536643 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-92c71a46-6fbf-4749-ac1f-3c34d3286e56 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:45.539021 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-92c71a46-6fbf-4749-ac1f-3c34d3286e56 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:45.540486 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-92c71a46-6fbf-4749-ac1f-3c34d3286e56 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 0.239534 Jan 28 02:03:45.562822 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 202/403] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:45 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:45.711784 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-117b9431-57e0-45d8-a996-901f352f0ea1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:45.713291 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-117b9431-57e0-45d8-a996-901f352f0ea1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:45.721508 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-117b9431-57e0-45d8-a996-901f352f0ea1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:45.722414 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-117b9431-57e0-45d8-a996-901f352f0ea1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:45.723585 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-117b9431-57e0-45d8-a996-901f352f0ea1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:45.724636 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-117b9431-57e0-45d8-a996-901f352f0ea1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:45.855919 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1c47b119-f7a5-457a-936f-98166f31a49a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:45.856527 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1c47b119-f7a5-457a-936f-98166f31a49a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:45.866555 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1c47b119-f7a5-457a-936f-98166f31a49a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:45.866967 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1c47b119-f7a5-457a-936f-98166f31a49a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:45.868693 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1c47b119-f7a5-457a-936f-98166f31a49a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:45.869132 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1c47b119-f7a5-457a-936f-98166f31a49a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:45.886200 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-117b9431-57e0-45d8-a996-901f352f0ea1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:45.895770 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-117b9431-57e0-45d8-a996-901f352f0ea1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.187479 Jan 28 02:03:45.906842 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 202/404] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:45 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:46.066136 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1c47b119-f7a5-457a-936f-98166f31a49a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:46.074861 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1c47b119-f7a5-457a-936f-98166f31a49a tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 0.225296 Jan 28 02:03:46.079307 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 203/405] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:45 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:46.559588 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a3aa7ce1-9e0f-43b1-ad29-dba878c93973 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:46.561032 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a3aa7ce1-9e0f-43b1-ad29-dba878c93973 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:46.568712 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a3aa7ce1-9e0f-43b1-ad29-dba878c93973 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:46.569466 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a3aa7ce1-9e0f-43b1-ad29-dba878c93973 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:46.570555 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a3aa7ce1-9e0f-43b1-ad29-dba878c93973 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:46.571252 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a3aa7ce1-9e0f-43b1-ad29-dba878c93973 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:46.869435 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a3aa7ce1-9e0f-43b1-ad29-dba878c93973 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:46.881430 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a3aa7ce1-9e0f-43b1-ad29-dba878c93973 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:46.887830 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a3aa7ce1-9e0f-43b1-ad29-dba878c93973 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:46.892945 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a3aa7ce1-9e0f-43b1-ad29-dba878c93973 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 0.334203 Jan 28 02:03:46.897142 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 203/406] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:46 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:46.913256 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-abc4a966-fdae-46a7-8718-cf12376437c1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:46.914674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-abc4a966-fdae-46a7-8718-cf12376437c1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:46.921919 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-abc4a966-fdae-46a7-8718-cf12376437c1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:46.923007 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-abc4a966-fdae-46a7-8718-cf12376437c1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:46.924044 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-abc4a966-fdae-46a7-8718-cf12376437c1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:46.924737 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-abc4a966-fdae-46a7-8718-cf12376437c1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:47.095773 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-fe2fda16-899c-43d7-a0f3-0a52060f3ebd tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:47.096294 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-fe2fda16-899c-43d7-a0f3-0a52060f3ebd tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:47.109034 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fe2fda16-899c-43d7-a0f3-0a52060f3ebd tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:47.115328 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fe2fda16-899c-43d7-a0f3-0a52060f3ebd tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:47.117595 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fe2fda16-899c-43d7-a0f3-0a52060f3ebd tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:47.121132 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fe2fda16-899c-43d7-a0f3-0a52060f3ebd tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:47.146930 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-abc4a966-fdae-46a7-8718-cf12376437c1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:47.183676 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-abc4a966-fdae-46a7-8718-cf12376437c1 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.273682 Jan 28 02:03:47.186377 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 204/407] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:46 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:47.322663 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-fe2fda16-899c-43d7-a0f3-0a52060f3ebd tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:47.332085 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-fe2fda16-899c-43d7-a0f3-0a52060f3ebd tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 0.240420 Jan 28 02:03:47.342491 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 204/408] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:47 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:47.576461 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-506c9691-a2d7-4f20-9aac-147e33803cb5 req-86683dd3-0b10-430a-b72a-56a8f622893c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba343337-b8f3-4f63-875e-c13b7711e8bf", "name": "network-vif-plugged", "status": "completed", "tag": "c105129e-5873-411f-b8e0-8fa24f669b60"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:47.578468 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:47.578468 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:03:47.588192 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-506c9691-a2d7-4f20-9aac-147e33803cb5 req-86683dd3-0b10-430a-b72a-56a8f622893c service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:47.588828 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-506c9691-a2d7-4f20-9aac-147e33803cb5 req-86683dd3-0b10-430a-b72a-56a8f622893c service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:47.604298 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-506c9691-a2d7-4f20-9aac-147e33803cb5 req-86683dd3-0b10-430a-b72a-56a8f622893c service nova] Creating event network-vif-plugged:c105129e-5873-411f-b8e0-8fa24f669b60 for instance ba343337-b8f3-4f63-875e-c13b7711e8bf on hv-cinder-82497 Jan 28 02:03:47.611483 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-506c9691-a2d7-4f20-9aac-147e33803cb5 req-86683dd3-0b10-430a-b72a-56a8f622893c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038939 Jan 28 02:03:47.612780 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 205/409] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:47.915685 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-73835bc9-0175-4e47-8152-21553ffb73ed tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:47.916361 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-73835bc9-0175-4e47-8152-21553ffb73ed tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:47.923536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-73835bc9-0175-4e47-8152-21553ffb73ed tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:47.923984 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-73835bc9-0175-4e47-8152-21553ffb73ed tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:47.925122 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-73835bc9-0175-4e47-8152-21553ffb73ed tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:47.925639 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-73835bc9-0175-4e47-8152-21553ffb73ed tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:48.099685 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-73835bc9-0175-4e47-8152-21553ffb73ed tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:48.108394 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-73835bc9-0175-4e47-8152-21553ffb73ed tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:48.110299 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-73835bc9-0175-4e47-8152-21553ffb73ed tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:48.111763 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-73835bc9-0175-4e47-8152-21553ffb73ed tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 0.200558 Jan 28 02:03:48.128751 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 205/410] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:47 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:48.203791 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a941f1ad-645b-46c5-ac4b-759b2abe0f8a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:48.205652 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a941f1ad-645b-46c5-ac4b-759b2abe0f8a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:48.212331 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a941f1ad-645b-46c5-ac4b-759b2abe0f8a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:48.212896 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a941f1ad-645b-46c5-ac4b-759b2abe0f8a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:48.213689 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a941f1ad-645b-46c5-ac4b-759b2abe0f8a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:48.214274 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a941f1ad-645b-46c5-ac4b-759b2abe0f8a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:48.356972 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a0e18446-a235-4fd7-b1ab-fad709495c85 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:48.358233 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a0e18446-a235-4fd7-b1ab-fad709495c85 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:48.370540 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a0e18446-a235-4fd7-b1ab-fad709495c85 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:48.371244 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a0e18446-a235-4fd7-b1ab-fad709495c85 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:48.372334 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a0e18446-a235-4fd7-b1ab-fad709495c85 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:48.375865 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a941f1ad-645b-46c5-ac4b-759b2abe0f8a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:48.376617 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a0e18446-a235-4fd7-b1ab-fad709495c85 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:48.387521 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a941f1ad-645b-46c5-ac4b-759b2abe0f8a tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.188070 Jan 28 02:03:48.388339 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 206/411] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:48 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:48.610202 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a0e18446-a235-4fd7-b1ab-fad709495c85 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:48.628932 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a0e18446-a235-4fd7-b1ab-fad709495c85 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 0.278813 Jan 28 02:03:48.629955 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 206/412] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:48 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:49.136006 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7f14ca47-ebaa-4478-a49e-6ad2109512a1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:49.136978 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7f14ca47-ebaa-4478-a49e-6ad2109512a1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:49.144278 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7f14ca47-ebaa-4478-a49e-6ad2109512a1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:49.144996 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7f14ca47-ebaa-4478-a49e-6ad2109512a1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:49.146031 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7f14ca47-ebaa-4478-a49e-6ad2109512a1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:49.146669 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7f14ca47-ebaa-4478-a49e-6ad2109512a1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:49.314542 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7f14ca47-ebaa-4478-a49e-6ad2109512a1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:49.324077 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7f14ca47-ebaa-4478-a49e-6ad2109512a1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:49.325733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7f14ca47-ebaa-4478-a49e-6ad2109512a1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:49.327719 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7f14ca47-ebaa-4478-a49e-6ad2109512a1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 0.195202 Jan 28 02:03:49.329043 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 207/413] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:49 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:03:49.409114 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7c47c16c-a4eb-41fa-be24-b3589d181150 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:49.410341 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7c47c16c-a4eb-41fa-be24-b3589d181150 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:49.416971 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7c47c16c-a4eb-41fa-be24-b3589d181150 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:49.417547 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7c47c16c-a4eb-41fa-be24-b3589d181150 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:49.418580 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7c47c16c-a4eb-41fa-be24-b3589d181150 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:49.419275 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7c47c16c-a4eb-41fa-be24-b3589d181150 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:49.596223 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7c47c16c-a4eb-41fa-be24-b3589d181150 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:49.606283 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7c47c16c-a4eb-41fa-be24-b3589d181150 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.204480 Jan 28 02:03:49.608307 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 207/414] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:49 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:49.647194 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bbb3ce74-2e33-4531-bcb3-b6813e8ff2a1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:49.647838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bbb3ce74-2e33-4531-bcb3-b6813e8ff2a1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:49.660127 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bbb3ce74-2e33-4531-bcb3-b6813e8ff2a1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:49.660982 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bbb3ce74-2e33-4531-bcb3-b6813e8ff2a1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:49.662003 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bbb3ce74-2e33-4531-bcb3-b6813e8ff2a1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:49.662782 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bbb3ce74-2e33-4531-bcb3-b6813e8ff2a1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:49.880380 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-bbb3ce74-2e33-4531-bcb3-b6813e8ff2a1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:49.888090 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-bbb3ce74-2e33-4531-bcb3-b6813e8ff2a1 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 0.244616 Jan 28 02:03:49.890437 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 208/415] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:49 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:50.350597 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ae1a9847-2d6e-4be6-8b21-a299b7129776 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:50.351565 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ae1a9847-2d6e-4be6-8b21-a299b7129776 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:50.362399 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ae1a9847-2d6e-4be6-8b21-a299b7129776 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:50.363374 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ae1a9847-2d6e-4be6-8b21-a299b7129776 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:50.364410 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ae1a9847-2d6e-4be6-8b21-a299b7129776 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:50.365660 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ae1a9847-2d6e-4be6-8b21-a299b7129776 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:50.555434 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ae1a9847-2d6e-4be6-8b21-a299b7129776 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:50.569677 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ae1a9847-2d6e-4be6-8b21-a299b7129776 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:50.571796 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ae1a9847-2d6e-4be6-8b21-a299b7129776 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:50.573354 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ae1a9847-2d6e-4be6-8b21-a299b7129776 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 0.228593 Jan 28 02:03:50.575651 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 208/416] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:50 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:50.625205 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e0a4b9b3-bf3a-4ad4-a2ee-28d210c2c5d8 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:50.625866 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e0a4b9b3-bf3a-4ad4-a2ee-28d210c2c5d8 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:50.635374 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e0a4b9b3-bf3a-4ad4-a2ee-28d210c2c5d8 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:50.636094 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e0a4b9b3-bf3a-4ad4-a2ee-28d210c2c5d8 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:50.637049 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e0a4b9b3-bf3a-4ad4-a2ee-28d210c2c5d8 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:50.637628 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e0a4b9b3-bf3a-4ad4-a2ee-28d210c2c5d8 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:50.818294 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e0a4b9b3-bf3a-4ad4-a2ee-28d210c2c5d8 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:50.831322 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e0a4b9b3-bf3a-4ad4-a2ee-28d210c2c5d8 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.210740 Jan 28 02:03:50.832062 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 209/417] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:50 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:50.915704 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5150ff0e-43f5-4483-97fe-728c41c7dcc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:50.916604 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5150ff0e-43f5-4483-97fe-728c41c7dcc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:50.923542 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5150ff0e-43f5-4483-97fe-728c41c7dcc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:50.926487 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5150ff0e-43f5-4483-97fe-728c41c7dcc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:50.927564 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5150ff0e-43f5-4483-97fe-728c41c7dcc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:50.929225 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5150ff0e-43f5-4483-97fe-728c41c7dcc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:51.125458 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5150ff0e-43f5-4483-97fe-728c41c7dcc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:51.135062 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5150ff0e-43f5-4483-97fe-728c41c7dcc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1316 microversion: 2.1 time: 0.223096 Jan 28 02:03:51.137801 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 209/418] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:50 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:51.594379 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d44238e2-bf97-46c3-b7f4-1385b5e07947 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:51.595467 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d44238e2-bf97-46c3-b7f4-1385b5e07947 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:51.604605 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d44238e2-bf97-46c3-b7f4-1385b5e07947 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:51.605350 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d44238e2-bf97-46c3-b7f4-1385b5e07947 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:51.606436 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d44238e2-bf97-46c3-b7f4-1385b5e07947 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:51.607085 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d44238e2-bf97-46c3-b7f4-1385b5e07947 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:51.850814 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9c758796-2a79-4285-bb31-23f20a43e85c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:51.852158 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9c758796-2a79-4285-bb31-23f20a43e85c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:51.876309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9c758796-2a79-4285-bb31-23f20a43e85c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:51.881445 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9c758796-2a79-4285-bb31-23f20a43e85c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:51.885444 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9c758796-2a79-4285-bb31-23f20a43e85c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:51.886303 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9c758796-2a79-4285-bb31-23f20a43e85c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:51.901297 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d44238e2-bf97-46c3-b7f4-1385b5e07947 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:51.912672 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d44238e2-bf97-46c3-b7f4-1385b5e07947 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:51.915553 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d44238e2-bf97-46c3-b7f4-1385b5e07947 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:51.929638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d44238e2-bf97-46c3-b7f4-1385b5e07947 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1743 microversion: 2.20 time: 0.332048 Jan 28 02:03:51.929638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 210/419] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:51 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1743 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:52.140218 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9c758796-2a79-4285-bb31-23f20a43e85c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:52.154975 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e241abf1-f2fc-4990-bf7f-c86cf0b00a26 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:52.155586 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e241abf1-f2fc-4990-bf7f-c86cf0b00a26 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:52.158638 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9c758796-2a79-4285-bb31-23f20a43e85c tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.313488 Jan 28 02:03:52.170625 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 210/420] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:51 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:52.173641 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e241abf1-f2fc-4990-bf7f-c86cf0b00a26 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:52.174164 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e241abf1-f2fc-4990-bf7f-c86cf0b00a26 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:52.175015 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e241abf1-f2fc-4990-bf7f-c86cf0b00a26 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:52.175443 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e241abf1-f2fc-4990-bf7f-c86cf0b00a26 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:52.234870 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1822c04b-247d-4f34-ab1a-6223e9e29b83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:52.236356 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1822c04b-247d-4f34-ab1a-6223e9e29b83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:52.244184 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1822c04b-247d-4f34-ab1a-6223e9e29b83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:52.244628 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1822c04b-247d-4f34-ab1a-6223e9e29b83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:52.250754 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1822c04b-247d-4f34-ab1a-6223e9e29b83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:52.251411 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1822c04b-247d-4f34-ab1a-6223e9e29b83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:52.299937 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.objects.instance [None req-1822c04b-247d-4f34-ab1a-6223e9e29b83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lazy-loading 'flavor' on Instance uuid 706d03a1-cf66-4cdb-8271-bb94ca669ad7 {{(pid=115760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:03:52.470016 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e241abf1-f2fc-4990-bf7f-c86cf0b00a26 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:52.483314 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e241abf1-f2fc-4990-bf7f-c86cf0b00a26 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1505 microversion: 2.1 time: 0.331744 Jan 28 02:03:52.485843 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 211/421] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:52 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:52.578788 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1822c04b-247d-4f34-ab1a-6223e9e29b83 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "POST /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/action" status: 200 len: 32 microversion: 2.1 time: 0.350013 Jan 28 02:03:52.580681 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 211/422] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:03:52 2022] POST /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:03:52.593384 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-07630446-8ee2-4411-a74e-03b3efe7cd5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:52.594333 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-07630446-8ee2-4411-a74e-03b3efe7cd5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:52.602076 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-07630446-8ee2-4411-a74e-03b3efe7cd5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:52.602620 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-07630446-8ee2-4411-a74e-03b3efe7cd5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:52.603439 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-07630446-8ee2-4411-a74e-03b3efe7cd5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:52.603915 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-07630446-8ee2-4411-a74e-03b3efe7cd5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:52.881259 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-07630446-8ee2-4411-a74e-03b3efe7cd5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:52.890355 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-07630446-8ee2-4411-a74e-03b3efe7cd5f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.302531 Jan 28 02:03:52.893906 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 212/423] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:52 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:52.944323 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-bd641190-a516-4da4-8d7f-9f456c79f600 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:52.945854 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-bd641190-a516-4da4-8d7f-9f456c79f600 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:52.955860 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bd641190-a516-4da4-8d7f-9f456c79f600 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:52.957408 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bd641190-a516-4da4-8d7f-9f456c79f600 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:52.963168 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bd641190-a516-4da4-8d7f-9f456c79f600 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:52.966299 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bd641190-a516-4da4-8d7f-9f456c79f600 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:53.178094 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ec909abe-ce91-4794-a244-02ae3bf93598 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:53.178094 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ec909abe-ce91-4794-a244-02ae3bf93598 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:53.188119 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec909abe-ce91-4794-a244-02ae3bf93598 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:53.191576 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec909abe-ce91-4794-a244-02ae3bf93598 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:53.192247 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec909abe-ce91-4794-a244-02ae3bf93598 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:53.192687 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec909abe-ce91-4794-a244-02ae3bf93598 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:53.453280 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bd641190-a516-4da4-8d7f-9f456c79f600 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:53.468942 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bd641190-a516-4da4-8d7f-9f456c79f600 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:53.472076 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bd641190-a516-4da4-8d7f-9f456c79f600 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:53.473885 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-bd641190-a516-4da4-8d7f-9f456c79f600 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1743 microversion: 2.20 time: 0.533524 Jan 28 02:03:53.475436 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 212/424] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:52 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1743 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:53.608425 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ec909abe-ce91-4794-a244-02ae3bf93598 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:53.622333 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ec909abe-ce91-4794-a244-02ae3bf93598 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.447403 Jan 28 02:03:53.624618 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 213/425] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:53 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:53.734737 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-5d678b3c-b2d2-4b43-8ac8-5cba8a923d4b req-97cd79d0-7ee1-4288-b09c-546854c63747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71af6d79-02c9-49a6-b39a-e9ff65a92bdd", "name": "network-vif-plugged", "status": "completed", "tag": "fa7d8f86-0dd8-42bc-8bab-c8aebe6a1fdb"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:53.737203 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:53.737203 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:03:53.747205 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-5d678b3c-b2d2-4b43-8ac8-5cba8a923d4b req-97cd79d0-7ee1-4288-b09c-546854c63747 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:53.748053 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-5d678b3c-b2d2-4b43-8ac8-5cba8a923d4b req-97cd79d0-7ee1-4288-b09c-546854c63747 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:53.780880 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-5d678b3c-b2d2-4b43-8ac8-5cba8a923d4b req-97cd79d0-7ee1-4288-b09c-546854c63747 service nova] Creating event network-vif-plugged:fa7d8f86-0dd8-42bc-8bab-c8aebe6a1fdb for instance 71af6d79-02c9-49a6-b39a-e9ff65a92bdd on hv-cinder-82497 Jan 28 02:03:53.788364 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-5d678b3c-b2d2-4b43-8ac8-5cba8a923d4b req-97cd79d0-7ee1-4288-b09c-546854c63747 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063821 Jan 28 02:03:53.790547 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 213/426] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:53.868688 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7f2dbc52-04a6-4a28-83cb-8f3d1dd44c2c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Action: 'create', calling method: .version_select at 0x7f08d668d1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1922191641"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:53.900739 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-7f2dbc52-04a6-4a28-83cb-8f3d1dd44c2c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Getting quotas for project 8f948307a28a46c882d15550cc527d3e. Resources: {'key_pairs'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:03:53.908304 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-7f2dbc52-04a6-4a28-83cb-8f3d1dd44c2c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Getting quotas for user 7abe1b4b11304db7965ce3e6d9c56c42 and project 8f948307a28a46c882d15550cc527d3e. Resources: {'key_pairs'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:03:53.913913 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4fec448c-6b44-4e8f-adf8-2eab10370be2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:53.914597 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4fec448c-6b44-4e8f-adf8-2eab10370be2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:53.922554 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4fec448c-6b44-4e8f-adf8-2eab10370be2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:53.923040 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4fec448c-6b44-4e8f-adf8-2eab10370be2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:53.924167 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4fec448c-6b44-4e8f-adf8-2eab10370be2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:53.924823 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4fec448c-6b44-4e8f-adf8-2eab10370be2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:54.165393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4fec448c-6b44-4e8f-adf8-2eab10370be2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:54.188953 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4fec448c-6b44-4e8f-adf8-2eab10370be2 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.273021 Jan 28 02:03:54.191089 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 214/427] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:53 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:54.202192 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-91a1ebd9-5720-4afb-bb7e-2e392750e2b8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6c3093b-6582-4f79-a5a1-99f192e16f36"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:54.203744 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-91a1ebd9-5720-4afb-bb7e-2e392750e2b8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:54.210326 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-91a1ebd9-5720-4afb-bb7e-2e392750e2b8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:54.210993 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-91a1ebd9-5720-4afb-bb7e-2e392750e2b8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:54.212004 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-91a1ebd9-5720-4afb-bb7e-2e392750e2b8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:54.212591 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-91a1ebd9-5720-4afb-bb7e-2e392750e2b8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:54.297026 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-7f2dbc52-04a6-4a28-83cb-8f3d1dd44c2c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Getting quotas for project 8f948307a28a46c882d15550cc527d3e. Resources: {'key_pairs'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:03:54.301633 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-7f2dbc52-04a6-4a28-83cb-8f3d1dd44c2c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Getting quotas for user 7abe1b4b11304db7965ce3e6d9c56c42 and project 8f948307a28a46c882d15550cc527d3e. Resources: {'key_pairs'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:03:54.318341 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7f2dbc52-04a6-4a28-83cb-8f3d1dd44c2c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.453565 Jan 28 02:03:54.326047 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 214/428] 10.222.0.77 () {60 vars in 1157 bytes} [Fri Jan 28 02:03:53 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:54.417189 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1526229474", "imageRef": "eeac82e0-58b5-4d7d-b3cc-ba12adb61887", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1922191641", "networks": [{"uuid": "74f32fac-79da-4565-bfb2-7c951102ee06"}]}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:54.480843 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.network.neutron [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] validate_networks() for [('74f32fac-79da-4565-bfb2-7c951102ee06', None, None, None, None, None)] {{(pid=115761) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:03:54.851228 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-91a1ebd9-5720-4afb-bb7e-2e392750e2b8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "POST /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655697 Jan 28 02:03:54.858193 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 215/429] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:03:54 2022] POST /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:54.890478 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-baaefe6a-7dd0-430d-8b91-0d5aad7f9327 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:54.891196 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-baaefe6a-7dd0-430d-8b91-0d5aad7f9327 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:54.910617 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-baaefe6a-7dd0-430d-8b91-0d5aad7f9327 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:54.911070 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-baaefe6a-7dd0-430d-8b91-0d5aad7f9327 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:54.911850 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-baaefe6a-7dd0-430d-8b91-0d5aad7f9327 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:54.912490 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-baaefe6a-7dd0-430d-8b91-0d5aad7f9327 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.269605 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-baaefe6a-7dd0-430d-8b91-0d5aad7f9327 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:55.283435 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-baaefe6a-7dd0-430d-8b91-0d5aad7f9327 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:55.288780 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-baaefe6a-7dd0-430d-8b91-0d5aad7f9327 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:55.290436 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-baaefe6a-7dd0-430d-8b91-0d5aad7f9327 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.411043 Jan 28 02:03:55.291852 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 216/430] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:54 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:55.298976 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-afc3623d-9a02-46c0-8faa-03f46b2dcf05 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:55.300170 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-afc3623d-9a02-46c0-8faa-03f46b2dcf05 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:55.308445 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-afc3623d-9a02-46c0-8faa-03f46b2dcf05 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:55.309367 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-afc3623d-9a02-46c0-8faa-03f46b2dcf05 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.311312 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-afc3623d-9a02-46c0-8faa-03f46b2dcf05 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:55.312185 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-afc3623d-9a02-46c0-8faa-03f46b2dcf05 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.502651 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Flavor limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:03:55.504176 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Image limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:03:55.505104 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Flavor pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:03:55.505805 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Image pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:03:55.506470 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:03:55.525126 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:55.525793 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.527025 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:55.528023 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.538631 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-afc3623d-9a02-46c0-8faa-03f46b2dcf05 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:55.546524 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-afc3623d-9a02-46c0-8faa-03f46b2dcf05 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1314 microversion: 2.1 time: 0.253135 Jan 28 02:03:55.547083 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 217/431] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:55 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:55.564048 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ee50fd28-fc9b-48db-875e-8c7f1e52d650 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:55.565389 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ee50fd28-fc9b-48db-875e-8c7f1e52d650 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:55.572689 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ee50fd28-fc9b-48db-875e-8c7f1e52d650 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:55.573391 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ee50fd28-fc9b-48db-875e-8c7f1e52d650 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.574505 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ee50fd28-fc9b-48db-875e-8c7f1e52d650 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:55.575099 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ee50fd28-fc9b-48db-875e-8c7f1e52d650 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.575291 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Getting quotas for project 8f948307a28a46c882d15550cc527d3e. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:03:55.587707 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Getting quotas for user 7abe1b4b11304db7965ce3e6d9c56c42 and project 8f948307a28a46c882d15550cc527d3e. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:03:55.609254 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Going to run 1 instances... {{(pid=115761) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:03:55.612696 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eeac82e0-58b5-4d7d-b3cc-ba12adb61887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:03:55.695008 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-662ecc0a-3f95-4084-bab3-7beff90811cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281455 Jan 28 02:03:55.696555 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 215/432] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 02:03:55.729925 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-19b091c2-2eae-46e7-bf3d-9e2bfcca0dcf tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:55.730704 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-19b091c2-2eae-46e7-bf3d-9e2bfcca0dcf tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:55.859564 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-19b091c2-2eae-46e7-bf3d-9e2bfcca0dcf tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:55.867353 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ee50fd28-fc9b-48db-875e-8c7f1e52d650 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:55.870783 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-19b091c2-2eae-46e7-bf3d-9e2bfcca0dcf tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1259 microversion: 2.1 time: 0.167540 Jan 28 02:03:55.877483 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 216/433] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:55 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:55.890762 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-189c583b-ea75-46d9-b07a-28280b3239fc req-1c27ad2e-f88d-4af1-a30a-40adf6264c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d048580-813a-43b7-ae1a-e0b1a9c8c234", "name": "network-vif-plugged", "status": "completed", "tag": "1c3eebfc-cf3d-4a86-8be4-2f39da195acf"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:55.890994 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ee50fd28-fc9b-48db-875e-8c7f1e52d650 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.324140 Jan 28 02:03:55.900458 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 218/434] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:55 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:55.900694 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:55.900694 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:03:55.929331 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-189c583b-ea75-46d9-b07a-28280b3239fc req-1c27ad2e-f88d-4af1-a30a-40adf6264c6d service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:55.929789 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-189c583b-ea75-46d9-b07a-28280b3239fc req-1c27ad2e-f88d-4af1-a30a-40adf6264c6d service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.967704 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-189c583b-ea75-46d9-b07a-28280b3239fc req-1c27ad2e-f88d-4af1-a30a-40adf6264c6d service nova] Creating event network-vif-plugged:1c3eebfc-cf3d-4a86-8be4-2f39da195acf for instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234 on hv-cinder-82497 Jan 28 02:03:55.973035 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-189c583b-ea75-46d9-b07a-28280b3239fc req-1c27ad2e-f88d-4af1-a30a-40adf6264c6d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094071 Jan 28 02:03:55.973629 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 217/435] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:56.318540 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-509bddc9-4b10-48c0-883b-02081e02d9ca tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:56.319758 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-509bddc9-4b10-48c0-883b-02081e02d9ca tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:56.344086 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-509bddc9-4b10-48c0-883b-02081e02d9ca tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:56.344732 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-509bddc9-4b10-48c0-883b-02081e02d9ca tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:56.345778 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-509bddc9-4b10-48c0-883b-02081e02d9ca tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:56.346294 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-509bddc9-4b10-48c0-883b-02081e02d9ca tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:56.569107 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e40984b5-f8c4-4972-856b-460ff8811070 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:56.570044 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e40984b5-f8c4-4972-856b-460ff8811070 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:56.585861 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-509bddc9-4b10-48c0-883b-02081e02d9ca tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:56.590505 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e40984b5-f8c4-4972-856b-460ff8811070 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:56.591036 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e40984b5-f8c4-4972-856b-460ff8811070 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:56.592473 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e40984b5-f8c4-4972-856b-460ff8811070 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:56.592917 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e40984b5-f8c4-4972-856b-460ff8811070 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:56.599912 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-509bddc9-4b10-48c0-883b-02081e02d9ca tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:56.608318 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-509bddc9-4b10-48c0-883b-02081e02d9ca tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:56.609777 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-509bddc9-4b10-48c0-883b-02081e02d9ca tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.295426 Jan 28 02:03:56.622188 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 219/436] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:56 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:56.836205 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e40984b5-f8c4-4972-856b-460ff8811070 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:56.847293 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e40984b5-f8c4-4972-856b-460ff8811070 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1498 microversion: 2.1 time: 0.283803 Jan 28 02:03:56.848866 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 218/437] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:56 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1498 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:56.901950 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8053c3e4-163c-4205-96e2-a3e68db1dcee tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:56.902903 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8053c3e4-163c-4205-96e2-a3e68db1dcee tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:56.914826 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-dcd697e7-7ead-4d14-a423-7967bbf11005 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:56.916683 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-dcd697e7-7ead-4d14-a423-7967bbf11005 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:56.937799 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8053c3e4-163c-4205-96e2-a3e68db1dcee tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:56.938219 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8053c3e4-163c-4205-96e2-a3e68db1dcee tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:56.943243 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dcd697e7-7ead-4d14-a423-7967bbf11005 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:56.943885 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8053c3e4-163c-4205-96e2-a3e68db1dcee tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:56.944366 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8053c3e4-163c-4205-96e2-a3e68db1dcee tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:56.946481 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dcd697e7-7ead-4d14-a423-7967bbf11005 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:56.952981 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dcd697e7-7ead-4d14-a423-7967bbf11005 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:56.953496 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dcd697e7-7ead-4d14-a423-7967bbf11005 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.145998 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8053c3e4-163c-4205-96e2-a3e68db1dcee tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:57.159349 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8053c3e4-163c-4205-96e2-a3e68db1dcee tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1255 microversion: 2.1 time: 0.261875 Jan 28 02:03:57.160917 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 220/438] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:56 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1255 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:57.329132 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dcd697e7-7ead-4d14-a423-7967bbf11005 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:57.338032 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-dcd697e7-7ead-4d14-a423-7967bbf11005 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.432748 Jan 28 02:03:57.338504 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 219/439] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:56 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:57.652027 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5f37584f-f066-40e0-ba08-50e8174a6b74 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:57.653067 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5f37584f-f066-40e0-ba08-50e8174a6b74 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:57.669952 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5f37584f-f066-40e0-ba08-50e8174a6b74 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:57.675249 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5f37584f-f066-40e0-ba08-50e8174a6b74 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.676934 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5f37584f-f066-40e0-ba08-50e8174a6b74 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:57.678244 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5f37584f-f066-40e0-ba08-50e8174a6b74 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.877255 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7ef5a401-5453-4dde-8700-4f95741a97b3 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:57.878439 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7ef5a401-5453-4dde-8700-4f95741a97b3 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:57.892878 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7ef5a401-5453-4dde-8700-4f95741a97b3 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:57.894018 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7ef5a401-5453-4dde-8700-4f95741a97b3 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.897386 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7ef5a401-5453-4dde-8700-4f95741a97b3 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:57.898057 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7ef5a401-5453-4dde-8700-4f95741a97b3 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.996245 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7ef5a401-5453-4dde-8700-4f95741a97b3 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Going to try to terminate instance {{(pid=115761) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:03:58.111659 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5f37584f-f066-40e0-ba08-50e8174a6b74 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:58.122724 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5f37584f-f066-40e0-ba08-50e8174a6b74 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:58.128618 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5f37584f-f066-40e0-ba08-50e8174a6b74 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:58.130970 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5f37584f-f066-40e0-ba08-50e8174a6b74 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.505073 Jan 28 02:03:58.133992 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 221/440] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:57 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:03:58.163958 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7ef5a401-5453-4dde-8700-4f95741a97b3 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "DELETE /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 204 len: 0 microversion: 2.1 time: 0.291584 Jan 28 02:03:58.171395 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 220/441] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:03:57 2022] DELETE /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:03:58.175025 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3cac32d6-b746-42f0-8cbc-f51e4d1e9c77 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:58.175610 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3cac32d6-b746-42f0-8cbc-f51e4d1e9c77 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:58.187034 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-11aacced-6a64-4e58-9737-aa307ad819b4 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:58.191113 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3cac32d6-b746-42f0-8cbc-f51e4d1e9c77 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:58.191558 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3cac32d6-b746-42f0-8cbc-f51e4d1e9c77 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:58.192340 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3cac32d6-b746-42f0-8cbc-f51e4d1e9c77 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:58.192769 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3cac32d6-b746-42f0-8cbc-f51e4d1e9c77 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:58.195793 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-11aacced-6a64-4e58-9737-aa307ad819b4 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:58.214687 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-11aacced-6a64-4e58-9737-aa307ad819b4 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:58.215036 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-11aacced-6a64-4e58-9737-aa307ad819b4 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:58.215829 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-11aacced-6a64-4e58-9737-aa307ad819b4 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:58.216262 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-11aacced-6a64-4e58-9737-aa307ad819b4 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:58.470728 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-11aacced-6a64-4e58-9737-aa307ad819b4 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:58.495575 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-11aacced-6a64-4e58-9737-aa307ad819b4 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1317 microversion: 2.1 time: 0.312960 Jan 28 02:03:58.496860 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 221/442] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:58 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:58.523765 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-43ea53e2-c82a-4421-9b31-61e163c631af tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:58.524797 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-43ea53e2-c82a-4421-9b31-61e163c631af tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:58.535798 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-43ea53e2-c82a-4421-9b31-61e163c631af tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:58.536250 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-43ea53e2-c82a-4421-9b31-61e163c631af tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:58.539922 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-43ea53e2-c82a-4421-9b31-61e163c631af tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:58.540270 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-43ea53e2-c82a-4421-9b31-61e163c631af tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:58.586789 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-3cac32d6-b746-42f0-8cbc-f51e4d1e9c77 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:58.603301 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3cac32d6-b746-42f0-8cbc-f51e4d1e9c77 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1504 microversion: 2.1 time: 0.429738 Jan 28 02:03:58.606215 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 222/443] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:58 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:58.849781 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-43ea53e2-c82a-4421-9b31-61e163c631af tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:58.864408 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-43ea53e2-c82a-4421-9b31-61e163c631af tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.365421 Jan 28 02:03:58.865008 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 222/444] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:58 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:59.159901 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c6e3acd9-7374-4a43-80a9-df09cd8d92cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:59.161824 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c6e3acd9-7374-4a43-80a9-df09cd8d92cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:59.173857 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c6e3acd9-7374-4a43-80a9-df09cd8d92cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:59.174201 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c6e3acd9-7374-4a43-80a9-df09cd8d92cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:59.175389 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c6e3acd9-7374-4a43-80a9-df09cd8d92cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:59.176284 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c6e3acd9-7374-4a43-80a9-df09cd8d92cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:59.515199 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ab4f13aa-882c-44d4-8b94-a1cbec7a95f5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:59.515838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ab4f13aa-882c-44d4-8b94-a1cbec7a95f5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:59.531074 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ab4f13aa-882c-44d4-8b94-a1cbec7a95f5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:59.531788 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ab4f13aa-882c-44d4-8b94-a1cbec7a95f5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:59.533336 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ab4f13aa-882c-44d4-8b94-a1cbec7a95f5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:59.545472 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c6e3acd9-7374-4a43-80a9-df09cd8d92cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:59.545665 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ab4f13aa-882c-44d4-8b94-a1cbec7a95f5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:59.574391 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c6e3acd9-7374-4a43-80a9-df09cd8d92cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:59.579221 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c6e3acd9-7374-4a43-80a9-df09cd8d92cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:59.580812 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c6e3acd9-7374-4a43-80a9-df09cd8d92cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.431503 Jan 28 02:03:59.581895 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 223/445] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:59 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:59.626314 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-16176786-3dc4-4ba6-ac26-4d64a149f9e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:59.627778 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-16176786-3dc4-4ba6-ac26-4d64a149f9e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:59.649296 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-16176786-3dc4-4ba6-ac26-4d64a149f9e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:59.650408 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-16176786-3dc4-4ba6-ac26-4d64a149f9e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:59.651615 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-16176786-3dc4-4ba6-ac26-4d64a149f9e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:59.661617 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-16176786-3dc4-4ba6-ac26-4d64a149f9e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:59.938954 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ab4f13aa-882c-44d4-8b94-a1cbec7a95f5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:59.949947 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ab4f13aa-882c-44d4-8b94-a1cbec7a95f5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.439705 Jan 28 02:03:59.952133 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 223/446] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:59 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:59.959955 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4e2033fb-da59-43fc-a18c-86b653bc5e14 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:59.961378 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4e2033fb-da59-43fc-a18c-86b653bc5e14 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:59.971087 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4e2033fb-da59-43fc-a18c-86b653bc5e14 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:59.972297 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4e2033fb-da59-43fc-a18c-86b653bc5e14 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:59.975448 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4e2033fb-da59-43fc-a18c-86b653bc5e14 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:59.976704 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4e2033fb-da59-43fc-a18c-86b653bc5e14 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:00.026783 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-16176786-3dc4-4ba6-ac26-4d64a149f9e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:00.035644 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-16176786-3dc4-4ba6-ac26-4d64a149f9e9 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1504 microversion: 2.1 time: 0.416653 Jan 28 02:04:00.038423 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 224/447] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:59 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:00.264308 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4e2033fb-da59-43fc-a18c-86b653bc5e14 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:00.280411 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4e2033fb-da59-43fc-a18c-86b653bc5e14 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.326719 Jan 28 02:04:00.285985 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 224/448] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:59 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:00.602664 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-50218367-2cea-4fee-be9e-f6267cb6b303 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:00.603270 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-50218367-2cea-4fee-be9e-f6267cb6b303 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:00.614050 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-50218367-2cea-4fee-be9e-f6267cb6b303 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:00.614507 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-50218367-2cea-4fee-be9e-f6267cb6b303 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:00.615468 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-50218367-2cea-4fee-be9e-f6267cb6b303 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:00.615912 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-50218367-2cea-4fee-be9e-f6267cb6b303 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:00.968717 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ca418cb3-2684-47b2-a9ed-afe7c889726b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:00.970419 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ca418cb3-2684-47b2-a9ed-afe7c889726b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:00.980655 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-50218367-2cea-4fee-be9e-f6267cb6b303 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:00.981844 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ca418cb3-2684-47b2-a9ed-afe7c889726b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:00.983038 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ca418cb3-2684-47b2-a9ed-afe7c889726b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:00.984782 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ca418cb3-2684-47b2-a9ed-afe7c889726b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:00.985693 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ca418cb3-2684-47b2-a9ed-afe7c889726b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:01.032027 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-50218367-2cea-4fee-be9e-f6267cb6b303 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:01.047953 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-50218367-2cea-4fee-be9e-f6267cb6b303 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:01.051036 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-50218367-2cea-4fee-be9e-f6267cb6b303 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.451956 Jan 28 02:04:01.051853 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 225/449] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:00 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:01.059622 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-e1d45fcf-ebf6-430e-9407-12da417c6ec2 req-c0d10475-9a0d-40fa-b252-e293b04a6514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99e0d03-1fe8-4dd7-9c5d-e67a633ab920", "tag": "df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:01.071941 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:01.071941 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:04:01.097625 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-e1d45fcf-ebf6-430e-9407-12da417c6ec2 req-c0d10475-9a0d-40fa-b252-e293b04a6514 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:01.102402 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-e1d45fcf-ebf6-430e-9407-12da417c6ec2 req-c0d10475-9a0d-40fa-b252-e293b04a6514 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:01.144210 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-e1d45fcf-ebf6-430e-9407-12da417c6ec2 req-c0d10475-9a0d-40fa-b252-e293b04a6514 service nova] Creating event network-changed:df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1 for instance b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 on hv-cinder-82497 Jan 28 02:04:01.164332 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-e1d45fcf-ebf6-430e-9407-12da417c6ec2 req-c0d10475-9a0d-40fa-b252-e293b04a6514 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108097 Jan 28 02:04:01.165310 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 226/450] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:01.179605 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-0344010f-1c5a-4267-8e15-331390d6beb2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:01.180323 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-0344010f-1c5a-4267-8e15-331390d6beb2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:01.202252 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0344010f-1c5a-4267-8e15-331390d6beb2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:01.202783 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0344010f-1c5a-4267-8e15-331390d6beb2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:01.203655 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0344010f-1c5a-4267-8e15-331390d6beb2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:01.204106 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0344010f-1c5a-4267-8e15-331390d6beb2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:01.379341 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-0344010f-1c5a-4267-8e15-331390d6beb2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:01.399645 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-0344010f-1c5a-4267-8e15-331390d6beb2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1462 microversion: 2.1 time: 0.228083 Jan 28 02:04:01.401067 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 227/451] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:01 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1462 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:01.406876 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-31865d13-5fd0-4aa3-bf05-01b61cb41496 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:01.407778 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-31865d13-5fd0-4aa3-bf05-01b61cb41496 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:01.413351 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ca418cb3-2684-47b2-a9ed-afe7c889726b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:01.437279 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-31865d13-5fd0-4aa3-bf05-01b61cb41496 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:01.438823 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-31865d13-5fd0-4aa3-bf05-01b61cb41496 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:01.440478 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-31865d13-5fd0-4aa3-bf05-01b61cb41496 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:01.441519 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-31865d13-5fd0-4aa3-bf05-01b61cb41496 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:01.457089 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ca418cb3-2684-47b2-a9ed-afe7c889726b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.490503 Jan 28 02:04:01.458278 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 225/452] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:00 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:01.476505 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-e659c454-0820-4d56-bd53-4e1fc8925af3 req-c1a32ddb-0bfe-42ab-bc95-2e02d6b6a86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71af6d79-02c9-49a6-b39a-e9ff65a92bdd", "name": "network-vif-deleted", "tag": "fa7d8f86-0dd8-42bc-8bab-c8aebe6a1fdb"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:01.480859 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:01.480859 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:04:01.502580 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-e659c454-0820-4d56-bd53-4e1fc8925af3 req-c1a32ddb-0bfe-42ab-bc95-2e02d6b6a86e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:01.503352 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-e659c454-0820-4d56-bd53-4e1fc8925af3 req-c1a32ddb-0bfe-42ab-bc95-2e02d6b6a86e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:01.539383 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-e659c454-0820-4d56-bd53-4e1fc8925af3 req-c1a32ddb-0bfe-42ab-bc95-2e02d6b6a86e service nova] Creating event network-vif-deleted:fa7d8f86-0dd8-42bc-8bab-c8aebe6a1fdb for instance 71af6d79-02c9-49a6-b39a-e9ff65a92bdd on hv-cinder-82497 Jan 28 02:04:01.552341 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-e659c454-0820-4d56-bd53-4e1fc8925af3 req-c1a32ddb-0bfe-42ab-bc95-2e02d6b6a86e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085182 Jan 28 02:04:01.556127 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 226/453] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:01.865717 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-31865d13-5fd0-4aa3-bf05-01b61cb41496 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:01.874170 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-31865d13-5fd0-4aa3-bf05-01b61cb41496 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.471615 Jan 28 02:04:01.874742 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 228/454] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:01 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:02.073048 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-aac08091-1f28-425c-9d0c-072937401b62 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:02.074453 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-aac08091-1f28-425c-9d0c-072937401b62 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:02.091187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aac08091-1f28-425c-9d0c-072937401b62 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.092515 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aac08091-1f28-425c-9d0c-072937401b62 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:02.096601 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aac08091-1f28-425c-9d0c-072937401b62 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.097058 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aac08091-1f28-425c-9d0c-072937401b62 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:02.419537 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d57cedf6-ac4a-4ae2-b591-e6a02e592bec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:02.420698 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d57cedf6-ac4a-4ae2-b591-e6a02e592bec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:02.435179 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d57cedf6-ac4a-4ae2-b591-e6a02e592bec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.441257 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d57cedf6-ac4a-4ae2-b591-e6a02e592bec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:02.442508 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d57cedf6-ac4a-4ae2-b591-e6a02e592bec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.445793 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d57cedf6-ac4a-4ae2-b591-e6a02e592bec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:02.521873 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d57cedf6-ac4a-4ae2-b591-e6a02e592bec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.523150 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d57cedf6-ac4a-4ae2-b591-e6a02e592bec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:02.523637 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.objects.instance [None req-d57cedf6-ac4a-4ae2-b591-e6a02e592bec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lazy-loading 'fault' on Instance uuid 71af6d79-02c9-49a6-b39a-e9ff65a92bdd {{(pid=115760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:02.573396 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-aac08091-1f28-425c-9d0c-072937401b62 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:02.590243 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-aac08091-1f28-425c-9d0c-072937401b62 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:02.593137 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-aac08091-1f28-425c-9d0c-072937401b62 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:02.597947 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-aac08091-1f28-425c-9d0c-072937401b62 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.529973 Jan 28 02:04:02.600239 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 227/455] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:02 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:02.614606 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d57cedf6-ac4a-4ae2-b591-e6a02e592bec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85e8545e634ff99938a4c9dfa1bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6ea7ebf03d4ba89b2158cb1610b391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:02.621966 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-9d5dda5a-7b87-4510-a5d7-5bdc53426a08 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:02.624140 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d57cedf6-ac4a-4ae2-b591-e6a02e592bec tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 200 len: 1304 microversion: 2.1 time: 0.208456 Jan 28 02:04:02.625482 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-9d5dda5a-7b87-4510-a5d7-5bdc53426a08 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:02.626410 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 229/456] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:02 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 1304 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:02.634255 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9d5dda5a-7b87-4510-a5d7-5bdc53426a08 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.635756 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9d5dda5a-7b87-4510-a5d7-5bdc53426a08 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:02.636497 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9d5dda5a-7b87-4510-a5d7-5bdc53426a08 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.637034 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9d5dda5a-7b87-4510-a5d7-5bdc53426a08 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:02.891919 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-68565be9-6ab0-479e-bdd2-b3a83bff5ee5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:02.893382 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-68565be9-6ab0-479e-bdd2-b3a83bff5ee5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:02.905145 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-68565be9-6ab0-479e-bdd2-b3a83bff5ee5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.906023 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-68565be9-6ab0-479e-bdd2-b3a83bff5ee5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:02.915163 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-68565be9-6ab0-479e-bdd2-b3a83bff5ee5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.915872 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-68565be9-6ab0-479e-bdd2-b3a83bff5ee5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:03.315078 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-9d5dda5a-7b87-4510-a5d7-5bdc53426a08 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:03.327444 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-9d5dda5a-7b87-4510-a5d7-5bdc53426a08 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.722003 Jan 28 02:04:03.328411 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 228/457] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:02 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:03.344434 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-631dc05f-cbbd-4bbf-9d56-fd04bee36bea tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:03.345246 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-631dc05f-cbbd-4bbf-9d56-fd04bee36bea tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:03.351516 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-631dc05f-cbbd-4bbf-9d56-fd04bee36bea tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:03.352178 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-631dc05f-cbbd-4bbf-9d56-fd04bee36bea tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:03.353401 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-631dc05f-cbbd-4bbf-9d56-fd04bee36bea tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:03.354028 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-631dc05f-cbbd-4bbf-9d56-fd04bee36bea tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:03.478326 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-68565be9-6ab0-479e-bdd2-b3a83bff5ee5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:03.487636 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-68565be9-6ab0-479e-bdd2-b3a83bff5ee5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.600082 Jan 28 02:04:03.496220 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 230/458] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:02 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:03.528640 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-631dc05f-cbbd-4bbf-9d56-fd04bee36bea tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lazy-loading 'services' on Instance uuid ba343337-b8f3-4f63-875e-c13b7711e8bf {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:03.621704 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-49e97214-a0f3-46ac-b907-921be86fc044 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:03.625383 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-49e97214-a0f3-46ac-b907-921be86fc044 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:03.643321 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-49e97214-a0f3-46ac-b907-921be86fc044 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:03.644936 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-49e97214-a0f3-46ac-b907-921be86fc044 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:03.647616 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-49e97214-a0f3-46ac-b907-921be86fc044 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:03.649282 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-49e97214-a0f3-46ac-b907-921be86fc044 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:03.649439 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-631dc05f-cbbd-4bbf-9d56-fd04bee36bea tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "DELETE /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf/os-volume_attachments/b6c3093b-6582-4f79-a5a1-99f192e16f36" status: 202 len: 0 microversion: 2.1 time: 0.312839 Jan 28 02:04:03.650096 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 229/459] 10.222.0.77 () {58 vars in 1415 bytes} [Fri Jan 28 02:04:03 2022] DELETE /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf/os-volume_attachments/b6c3093b-6582-4f79-a5a1-99f192e16f36 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:04:03.665179 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1d3ff922-f41b-4e90-bb2a-40f10f307de2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:03.666332 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1d3ff922-f41b-4e90-bb2a-40f10f307de2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] [instance: 71af6d79-02c9-49a6-b39a-e9ff65a92bdd] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:03.686500 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1d3ff922-f41b-4e90-bb2a-40f10f307de2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:03.687360 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1d3ff922-f41b-4e90-bb2a-40f10f307de2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:03.688798 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1d3ff922-f41b-4e90-bb2a-40f10f307de2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:03.694722 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1d3ff922-f41b-4e90-bb2a-40f10f307de2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:03.731261 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-1d3ff922-f41b-4e90-bb2a-40f10f307de2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] HTTP exception thrown: Instance 71af6d79-02c9-49a6-b39a-e9ff65a92bdd could not be found. Jan 28 02:04:03.732611 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1d3ff922-f41b-4e90-bb2a-40f10f307de2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] Returning 404 to user: Instance 71af6d79-02c9-49a6-b39a-e9ff65a92bdd could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:03.734281 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1d3ff922-f41b-4e90-bb2a-40f10f307de2 tempest-VolumesActionsTest-96939119 tempest-VolumesActionsTest-96939119-project] 10.222.0.77 "GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd" status: 404 len: 111 microversion: 2.1 time: 0.082065 Jan 28 02:04:03.736022 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 230/460] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:03 2022] GET /compute/v2.1/servers/71af6d79-02c9-49a6-b39a-e9ff65a92bdd => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:04:03.750950 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d847d88d-83fc-4d50-a7b7-e282cff340de tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:03.753536 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d847d88d-83fc-4d50-a7b7-e282cff340de tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:03.770937 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d847d88d-83fc-4d50-a7b7-e282cff340de tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:03.774515 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d847d88d-83fc-4d50-a7b7-e282cff340de tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:03.783482 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d847d88d-83fc-4d50-a7b7-e282cff340de tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:03.787065 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d847d88d-83fc-4d50-a7b7-e282cff340de tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:03.854436 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d847d88d-83fc-4d50-a7b7-e282cff340de tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117013 Jan 28 02:04:03.855997 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 231/461] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:04:03 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:03.905506 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-49e97214-a0f3-46ac-b907-921be86fc044 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:03.916473 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-49e97214-a0f3-46ac-b907-921be86fc044 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:03.918277 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-49e97214-a0f3-46ac-b907-921be86fc044 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:03.919524 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-49e97214-a0f3-46ac-b907-921be86fc044 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.304465 Jan 28 02:04:03.920862 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 231/462] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:03 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:04.347760 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-300a5c6f-845e-4a5f-9407-6a08e5b13f6b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:04.348733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-300a5c6f-845e-4a5f-9407-6a08e5b13f6b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:04.363202 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-300a5c6f-845e-4a5f-9407-6a08e5b13f6b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:04.363525 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-300a5c6f-845e-4a5f-9407-6a08e5b13f6b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:04.364857 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-300a5c6f-845e-4a5f-9407-6a08e5b13f6b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:04.365459 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-300a5c6f-845e-4a5f-9407-6a08e5b13f6b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:04.522094 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-86533b6e-f0d8-40f8-b698-767ae0754dd4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:04.522893 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-86533b6e-f0d8-40f8-b698-767ae0754dd4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:04.539994 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-300a5c6f-845e-4a5f-9407-6a08e5b13f6b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:04.548822 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-86533b6e-f0d8-40f8-b698-767ae0754dd4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:04.549296 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-86533b6e-f0d8-40f8-b698-767ae0754dd4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:04.550514 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-86533b6e-f0d8-40f8-b698-767ae0754dd4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:04.551157 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-86533b6e-f0d8-40f8-b698-767ae0754dd4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:04.554390 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-300a5c6f-845e-4a5f-9407-6a08e5b13f6b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.210400 Jan 28 02:04:04.571867 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 232/463] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:04 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:04.825349 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-86533b6e-f0d8-40f8-b698-767ae0754dd4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:04.892198 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-86533b6e-f0d8-40f8-b698-767ae0754dd4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.383906 Jan 28 02:04:04.892801 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 232/464] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:04 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:04.913175 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d92cc224-f96e-4016-996a-98ea79e03e67 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:04.914442 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d92cc224-f96e-4016-996a-98ea79e03e67 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:04.921723 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d92cc224-f96e-4016-996a-98ea79e03e67 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:04.922399 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d92cc224-f96e-4016-996a-98ea79e03e67 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:04.923496 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d92cc224-f96e-4016-996a-98ea79e03e67 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:04.924268 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d92cc224-f96e-4016-996a-98ea79e03e67 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:04.939475 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ea68d18f-8423-435a-8fcb-1fe8a460ee1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:04.940944 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ea68d18f-8423-435a-8fcb-1fe8a460ee1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:04.949602 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea68d18f-8423-435a-8fcb-1fe8a460ee1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:04.950094 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea68d18f-8423-435a-8fcb-1fe8a460ee1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:04.954255 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea68d18f-8423-435a-8fcb-1fe8a460ee1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:04.954707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea68d18f-8423-435a-8fcb-1fe8a460ee1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:05.001833 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d92cc224-f96e-4016-996a-98ea79e03e67 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123786 Jan 28 02:04:05.005867 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 233/465] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:04:04 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:05.169339 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ea68d18f-8423-435a-8fcb-1fe8a460ee1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:05.186751 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ea68d18f-8423-435a-8fcb-1fe8a460ee1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:05.190271 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ea68d18f-8423-435a-8fcb-1fe8a460ee1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:05.191965 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ea68d18f-8423-435a-8fcb-1fe8a460ee1c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.256726 Jan 28 02:04:05.204080 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 233/466] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:04 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:05.582768 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-43343a9f-7a10-4620-8ab6-5f53c346610b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:05.584168 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-43343a9f-7a10-4620-8ab6-5f53c346610b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:05.593047 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-43343a9f-7a10-4620-8ab6-5f53c346610b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:05.593739 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-43343a9f-7a10-4620-8ab6-5f53c346610b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:05.595040 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-43343a9f-7a10-4620-8ab6-5f53c346610b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:05.595950 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-43343a9f-7a10-4620-8ab6-5f53c346610b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:05.840140 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-43343a9f-7a10-4620-8ab6-5f53c346610b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:05.848576 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-43343a9f-7a10-4620-8ab6-5f53c346610b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.273249 Jan 28 02:04:05.862445 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 234/467] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:05 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:05.915639 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-83828d17-eb42-406f-b7be-beb79417b71e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:05.916292 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-83828d17-eb42-406f-b7be-beb79417b71e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:05.929889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-83828d17-eb42-406f-b7be-beb79417b71e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:05.930349 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-83828d17-eb42-406f-b7be-beb79417b71e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:05.931139 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-83828d17-eb42-406f-b7be-beb79417b71e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:05.931573 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-83828d17-eb42-406f-b7be-beb79417b71e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:06.014152 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-56f659c8-0854-4ea4-998d-19f814411b94 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:06.015417 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-56f659c8-0854-4ea4-998d-19f814411b94 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:06.031861 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-56f659c8-0854-4ea4-998d-19f814411b94 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:06.032597 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-56f659c8-0854-4ea4-998d-19f814411b94 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:06.034536 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-56f659c8-0854-4ea4-998d-19f814411b94 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:06.035239 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-56f659c8-0854-4ea4-998d-19f814411b94 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:06.081461 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-56f659c8-0854-4ea4-998d-19f814411b94 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070857 Jan 28 02:04:06.082388 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 235/468] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:04:06 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 02:04:06.203897 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-83828d17-eb42-406f-b7be-beb79417b71e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:06.213313 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-05024ed0-29a7-4070-9af8-b04bd8c0d029 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:06.215871 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-05024ed0-29a7-4070-9af8-b04bd8c0d029 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:06.227456 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-05024ed0-29a7-4070-9af8-b04bd8c0d029 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:06.228246 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-83828d17-eb42-406f-b7be-beb79417b71e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.320030 Jan 28 02:04:06.228832 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 234/469] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:05 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:06.229600 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-05024ed0-29a7-4070-9af8-b04bd8c0d029 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:06.230648 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-05024ed0-29a7-4070-9af8-b04bd8c0d029 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:06.231258 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-05024ed0-29a7-4070-9af8-b04bd8c0d029 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:06.440439 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-05024ed0-29a7-4070-9af8-b04bd8c0d029 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:06.454247 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-05024ed0-29a7-4070-9af8-b04bd8c0d029 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:06.456889 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-05024ed0-29a7-4070-9af8-b04bd8c0d029 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:06.458857 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-05024ed0-29a7-4070-9af8-b04bd8c0d029 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.250728 Jan 28 02:04:06.471817 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 236/470] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:06 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:06.870715 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9df8defb-3e40-4a05-9624-0653396de52c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:06.871770 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9df8defb-3e40-4a05-9624-0653396de52c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:06.881347 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9df8defb-3e40-4a05-9624-0653396de52c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:06.890987 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9df8defb-3e40-4a05-9624-0653396de52c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:06.892416 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9df8defb-3e40-4a05-9624-0653396de52c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:06.893421 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9df8defb-3e40-4a05-9624-0653396de52c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.078476 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9df8defb-3e40-4a05-9624-0653396de52c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:07.093594 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9df8defb-3e40-4a05-9624-0653396de52c tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.230516 Jan 28 02:04:07.094663 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 235/471] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:06 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:07.248171 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c8f7148f-6e5a-4c64-9efe-22928d5099d0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:07.249979 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c8f7148f-6e5a-4c64-9efe-22928d5099d0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:07.281042 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8f7148f-6e5a-4c64-9efe-22928d5099d0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:07.282302 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8f7148f-6e5a-4c64-9efe-22928d5099d0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.283269 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8f7148f-6e5a-4c64-9efe-22928d5099d0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:07.283857 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8f7148f-6e5a-4c64-9efe-22928d5099d0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.442599 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7639b4b7-e08d-48a4-9d3b-cf39c8118bb6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:07.443856 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7639b4b7-e08d-48a4-9d3b-cf39c8118bb6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:07.458038 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7639b4b7-e08d-48a4-9d3b-cf39c8118bb6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:07.459138 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7639b4b7-e08d-48a4-9d3b-cf39c8118bb6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.462523 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7639b4b7-e08d-48a4-9d3b-cf39c8118bb6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:07.463244 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7639b4b7-e08d-48a4-9d3b-cf39c8118bb6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.514417 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7639b4b7-e08d-48a4-9d3b-cf39c8118bb6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:04:07.530603 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c8f7148f-6e5a-4c64-9efe-22928d5099d0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:07.544428 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c8f7148f-6e5a-4c64-9efe-22928d5099d0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.301127 Jan 28 02:04:07.555819 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 237/472] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:07 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:07.555819 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1e964248-ebcf-4c57-8782-00eeb32ce7d1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:07.556476 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1e964248-ebcf-4c57-8782-00eeb32ce7d1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:07.566867 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1e964248-ebcf-4c57-8782-00eeb32ce7d1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:07.567861 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1e964248-ebcf-4c57-8782-00eeb32ce7d1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.568964 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1e964248-ebcf-4c57-8782-00eeb32ce7d1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:07.569577 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1e964248-ebcf-4c57-8782-00eeb32ce7d1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.690723 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7639b4b7-e08d-48a4-9d3b-cf39c8118bb6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "DELETE /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 204 len: 0 microversion: 2.1 time: 0.251537 Jan 28 02:04:07.692796 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 236/473] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:04:07 2022] DELETE /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:04:07.705546 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-da98bd46-9081-49c3-8db9-eba990a6aa0f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:07.706275 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-da98bd46-9081-49c3-8db9-eba990a6aa0f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:07.724066 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1e964248-ebcf-4c57-8782-00eeb32ce7d1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:07.729344 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-da98bd46-9081-49c3-8db9-eba990a6aa0f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:07.730673 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-da98bd46-9081-49c3-8db9-eba990a6aa0f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.732115 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-da98bd46-9081-49c3-8db9-eba990a6aa0f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:07.734075 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-da98bd46-9081-49c3-8db9-eba990a6aa0f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.735049 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1e964248-ebcf-4c57-8782-00eeb32ce7d1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:07.736838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1e964248-ebcf-4c57-8782-00eeb32ce7d1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:07.738170 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1e964248-ebcf-4c57-8782-00eeb32ce7d1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.190030 Jan 28 02:04:07.739071 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 238/474] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:07 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:07.907585 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-da98bd46-9081-49c3-8db9-eba990a6aa0f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:07.919263 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-da98bd46-9081-49c3-8db9-eba990a6aa0f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1511 microversion: 2.1 time: 0.219521 Jan 28 02:04:07.920670 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 237/475] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:07 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:08.112014 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-dc7cc79d-1417-40a6-a020-83484afb7495 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:08.113167 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-dc7cc79d-1417-40a6-a020-83484afb7495 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:08.119794 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc7cc79d-1417-40a6-a020-83484afb7495 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:08.120539 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc7cc79d-1417-40a6-a020-83484afb7495 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:08.121555 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc7cc79d-1417-40a6-a020-83484afb7495 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:08.122395 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc7cc79d-1417-40a6-a020-83484afb7495 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:08.306871 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dc7cc79d-1417-40a6-a020-83484afb7495 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:08.325166 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-dc7cc79d-1417-40a6-a020-83484afb7495 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.216940 Jan 28 02:04:08.327299 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 239/476] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:08 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:08.569331 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-bcdd7dcd-3793-47e1-b9d5-b2143ef250e6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:08.569971 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-bcdd7dcd-3793-47e1-b9d5-b2143ef250e6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:08.577900 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bcdd7dcd-3793-47e1-b9d5-b2143ef250e6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:08.578406 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bcdd7dcd-3793-47e1-b9d5-b2143ef250e6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:08.579551 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bcdd7dcd-3793-47e1-b9d5-b2143ef250e6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:08.579907 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bcdd7dcd-3793-47e1-b9d5-b2143ef250e6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:08.758512 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-cc7fb971-ab56-425a-990e-df5afa40b35b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:08.759177 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-cc7fb971-ab56-425a-990e-df5afa40b35b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:08.771032 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cc7fb971-ab56-425a-990e-df5afa40b35b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:08.771539 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cc7fb971-ab56-425a-990e-df5afa40b35b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:08.782494 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cc7fb971-ab56-425a-990e-df5afa40b35b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:08.783200 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cc7fb971-ab56-425a-990e-df5afa40b35b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:08.816555 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bcdd7dcd-3793-47e1-b9d5-b2143ef250e6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:08.826474 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-bcdd7dcd-3793-47e1-b9d5-b2143ef250e6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.263064 Jan 28 02:04:08.841177 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 238/477] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:08 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:08.938305 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-70d5f4e3-7c82-46cb-b7e5-54698de1f423 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:08.939620 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-70d5f4e3-7c82-46cb-b7e5-54698de1f423 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:08.952944 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-70d5f4e3-7c82-46cb-b7e5-54698de1f423 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:08.954038 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-70d5f4e3-7c82-46cb-b7e5-54698de1f423 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:08.955816 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-70d5f4e3-7c82-46cb-b7e5-54698de1f423 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:08.956433 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-70d5f4e3-7c82-46cb-b7e5-54698de1f423 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:09.026937 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-cc7fb971-ab56-425a-990e-df5afa40b35b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:09.042742 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-cc7fb971-ab56-425a-990e-df5afa40b35b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:09.044343 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-cc7fb971-ab56-425a-990e-df5afa40b35b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:09.049896 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-cc7fb971-ab56-425a-990e-df5afa40b35b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.296701 Jan 28 02:04:09.050829 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 240/478] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:08 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:09.166840 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-70d5f4e3-7c82-46cb-b7e5-54698de1f423 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:09.179263 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-70d5f4e3-7c82-46cb-b7e5-54698de1f423 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1511 microversion: 2.1 time: 0.246496 Jan 28 02:04:09.182026 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 239/479] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:08 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1511 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:09.344536 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0bab7007-a490-4e15-a69b-255fb7dc395f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:09.346176 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0bab7007-a490-4e15-a69b-255fb7dc395f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:09.355134 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0bab7007-a490-4e15-a69b-255fb7dc395f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:09.361377 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0bab7007-a490-4e15-a69b-255fb7dc395f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:09.362600 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0bab7007-a490-4e15-a69b-255fb7dc395f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:09.363059 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0bab7007-a490-4e15-a69b-255fb7dc395f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:09.563964 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0bab7007-a490-4e15-a69b-255fb7dc395f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:09.580707 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0bab7007-a490-4e15-a69b-255fb7dc395f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.240523 Jan 28 02:04:09.594605 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 241/480] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:09 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:09.848166 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8f16eb17-1a83-4fa5-b588-7587abb2888a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:09.849191 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8f16eb17-1a83-4fa5-b588-7587abb2888a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:09.859917 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f16eb17-1a83-4fa5-b588-7587abb2888a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:09.860658 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f16eb17-1a83-4fa5-b588-7587abb2888a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:09.861983 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f16eb17-1a83-4fa5-b588-7587abb2888a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:09.862702 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f16eb17-1a83-4fa5-b588-7587abb2888a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.026536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8f16eb17-1a83-4fa5-b588-7587abb2888a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:10.035147 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8f16eb17-1a83-4fa5-b588-7587abb2888a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.194100 Jan 28 02:04:10.035763 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 240/481] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:09 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:10.069319 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-dc8a4d9f-aca1-495c-ac29-2252fc865583 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:10.069739 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-dc8a4d9f-aca1-495c-ac29-2252fc865583 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:10.076125 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc8a4d9f-aca1-495c-ac29-2252fc865583 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:10.076567 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc8a4d9f-aca1-495c-ac29-2252fc865583 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.077382 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc8a4d9f-aca1-495c-ac29-2252fc865583 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:10.077785 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc8a4d9f-aca1-495c-ac29-2252fc865583 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.198708 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-03d4f1c3-2e1b-4e1b-8a87-75d39f2fb3f4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:10.199322 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-03d4f1c3-2e1b-4e1b-8a87-75d39f2fb3f4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:10.207527 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-03d4f1c3-2e1b-4e1b-8a87-75d39f2fb3f4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:10.207963 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-03d4f1c3-2e1b-4e1b-8a87-75d39f2fb3f4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.208734 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-03d4f1c3-2e1b-4e1b-8a87-75d39f2fb3f4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:10.209160 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-03d4f1c3-2e1b-4e1b-8a87-75d39f2fb3f4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.230070 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dc8a4d9f-aca1-495c-ac29-2252fc865583 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:10.238692 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dc8a4d9f-aca1-495c-ac29-2252fc865583 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:10.240195 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dc8a4d9f-aca1-495c-ac29-2252fc865583 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:10.241375 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-dc8a4d9f-aca1-495c-ac29-2252fc865583 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.176604 Jan 28 02:04:10.241980 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 242/482] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:10 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:10.350768 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-03d4f1c3-2e1b-4e1b-8a87-75d39f2fb3f4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:10.359831 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-03d4f1c3-2e1b-4e1b-8a87-75d39f2fb3f4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1511 microversion: 2.1 time: 0.165120 Jan 28 02:04:10.360427 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 241/483] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:10 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:10.605236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4dd857a0-fb50-4886-973d-a787cfdf545a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:10.606019 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4dd857a0-fb50-4886-973d-a787cfdf545a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:10.613208 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4dd857a0-fb50-4886-973d-a787cfdf545a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:10.614064 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4dd857a0-fb50-4886-973d-a787cfdf545a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.615488 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4dd857a0-fb50-4886-973d-a787cfdf545a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:10.618843 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4dd857a0-fb50-4886-973d-a787cfdf545a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.754100 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4dd857a0-fb50-4886-973d-a787cfdf545a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:10.761813 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4dd857a0-fb50-4886-973d-a787cfdf545a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.160828 Jan 28 02:04:10.762426 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 243/484] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:10 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:11.055953 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-caca8fd0-dc70-4bde-b365-c7346aaf066a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:11.056677 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-caca8fd0-dc70-4bde-b365-c7346aaf066a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:11.064381 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-caca8fd0-dc70-4bde-b365-c7346aaf066a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:11.064822 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-caca8fd0-dc70-4bde-b365-c7346aaf066a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:11.065598 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-caca8fd0-dc70-4bde-b365-c7346aaf066a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:11.066059 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-caca8fd0-dc70-4bde-b365-c7346aaf066a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:11.218266 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-caca8fd0-dc70-4bde-b365-c7346aaf066a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:11.226574 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-caca8fd0-dc70-4bde-b365-c7346aaf066a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.176308 Jan 28 02:04:11.227152 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 242/485] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:11 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:11.264374 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c62e5087-7640-4c45-a63f-4ee5eb276398 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:11.264993 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c62e5087-7640-4c45-a63f-4ee5eb276398 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:11.279814 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c62e5087-7640-4c45-a63f-4ee5eb276398 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:11.280339 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c62e5087-7640-4c45-a63f-4ee5eb276398 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:11.281365 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c62e5087-7640-4c45-a63f-4ee5eb276398 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:11.282038 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c62e5087-7640-4c45-a63f-4ee5eb276398 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:11.376811 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-908afa53-9ec9-42b6-ba55-da3af8b858ca tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:11.377419 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-908afa53-9ec9-42b6-ba55-da3af8b858ca tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:11.392074 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-908afa53-9ec9-42b6-ba55-da3af8b858ca tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:11.393944 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-908afa53-9ec9-42b6-ba55-da3af8b858ca tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:11.393944 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-908afa53-9ec9-42b6-ba55-da3af8b858ca tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:11.393944 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-908afa53-9ec9-42b6-ba55-da3af8b858ca tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:11.447484 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c62e5087-7640-4c45-a63f-4ee5eb276398 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:11.457801 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c62e5087-7640-4c45-a63f-4ee5eb276398 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:11.460366 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c62e5087-7640-4c45-a63f-4ee5eb276398 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:11.461985 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c62e5087-7640-4c45-a63f-4ee5eb276398 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.201386 Jan 28 02:04:11.473257 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 244/486] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:11 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:11.549508 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-908afa53-9ec9-42b6-ba55-da3af8b858ca tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:11.560133 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-908afa53-9ec9-42b6-ba55-da3af8b858ca tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1511 microversion: 2.1 time: 0.187222 Jan 28 02:04:11.560805 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 243/487] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:11 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:11.781373 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3615210a-0e5a-482d-a396-b22ce9c783ae tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:11.783950 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3615210a-0e5a-482d-a396-b22ce9c783ae tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:11.791420 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3615210a-0e5a-482d-a396-b22ce9c783ae tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:11.791955 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3615210a-0e5a-482d-a396-b22ce9c783ae tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:11.792800 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3615210a-0e5a-482d-a396-b22ce9c783ae tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:11.793465 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3615210a-0e5a-482d-a396-b22ce9c783ae tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:11.968172 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3615210a-0e5a-482d-a396-b22ce9c783ae tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:11.977055 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3615210a-0e5a-482d-a396-b22ce9c783ae tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.200790 Jan 28 02:04:11.985804 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 245/488] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:11 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:12.249331 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d3bdf21e-1aba-4759-94e7-1c104eddcb2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:12.250034 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d3bdf21e-1aba-4759-94e7-1c104eddcb2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:12.271342 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d3bdf21e-1aba-4759-94e7-1c104eddcb2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:12.272066 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d3bdf21e-1aba-4759-94e7-1c104eddcb2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:12.273048 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d3bdf21e-1aba-4759-94e7-1c104eddcb2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:12.273472 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d3bdf21e-1aba-4759-94e7-1c104eddcb2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:12.422433 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d3bdf21e-1aba-4759-94e7-1c104eddcb2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:12.431566 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d3bdf21e-1aba-4759-94e7-1c104eddcb2c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.186397 Jan 28 02:04:12.432412 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 244/489] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:12 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:12.484014 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-19d0b158-d54b-4e51-91e0-e7d5c3114bf2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:12.484655 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-19d0b158-d54b-4e51-91e0-e7d5c3114bf2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:12.494104 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-19d0b158-d54b-4e51-91e0-e7d5c3114bf2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:12.494653 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-19d0b158-d54b-4e51-91e0-e7d5c3114bf2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:12.495704 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-19d0b158-d54b-4e51-91e0-e7d5c3114bf2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:12.496223 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-19d0b158-d54b-4e51-91e0-e7d5c3114bf2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:12.579425 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1bf59b11-c4d4-412e-bf2e-7e23c311bdfc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:12.580123 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1bf59b11-c4d4-412e-bf2e-7e23c311bdfc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:12.589336 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1bf59b11-c4d4-412e-bf2e-7e23c311bdfc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:12.589913 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1bf59b11-c4d4-412e-bf2e-7e23c311bdfc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:12.591105 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1bf59b11-c4d4-412e-bf2e-7e23c311bdfc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:12.591225 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1bf59b11-c4d4-412e-bf2e-7e23c311bdfc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:12.688547 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-19d0b158-d54b-4e51-91e0-e7d5c3114bf2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:12.699441 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-19d0b158-d54b-4e51-91e0-e7d5c3114bf2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:12.702317 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-19d0b158-d54b-4e51-91e0-e7d5c3114bf2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:12.703802 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-19d0b158-d54b-4e51-91e0-e7d5c3114bf2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.224155 Jan 28 02:04:12.715545 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 246/490] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:12 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:12.767881 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-1bf59b11-c4d4-412e-bf2e-7e23c311bdfc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:12.776385 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1bf59b11-c4d4-412e-bf2e-7e23c311bdfc tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1511 microversion: 2.1 time: 0.201720 Jan 28 02:04:12.777233 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 245/491] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:12 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:12.995181 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-82fd5758-6b59-4d7e-bb59-f0e16dc140cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:12.995725 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-82fd5758-6b59-4d7e-bb59-f0e16dc140cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:13.002519 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-82fd5758-6b59-4d7e-bb59-f0e16dc140cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:13.002976 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-82fd5758-6b59-4d7e-bb59-f0e16dc140cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:13.003774 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-82fd5758-6b59-4d7e-bb59-f0e16dc140cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:13.004253 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-82fd5758-6b59-4d7e-bb59-f0e16dc140cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:13.152183 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-82fd5758-6b59-4d7e-bb59-f0e16dc140cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:13.160846 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-82fd5758-6b59-4d7e-bb59-f0e16dc140cb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.169408 Jan 28 02:04:13.161851 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 247/492] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:12 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:13.451544 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-33058678-f11d-49d1-a04d-5db961522b1d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:13.452174 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-33058678-f11d-49d1-a04d-5db961522b1d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:13.459188 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-33058678-f11d-49d1-a04d-5db961522b1d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:13.459637 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-33058678-f11d-49d1-a04d-5db961522b1d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:13.460533 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-33058678-f11d-49d1-a04d-5db961522b1d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:13.460958 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-33058678-f11d-49d1-a04d-5db961522b1d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:13.651904 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-33058678-f11d-49d1-a04d-5db961522b1d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:13.665954 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-33058678-f11d-49d1-a04d-5db961522b1d tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.217173 Jan 28 02:04:13.667406 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 246/493] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:13 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:13.722728 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-11786e2a-5ec1-43e1-a9cc-e603357350ba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:13.723333 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-11786e2a-5ec1-43e1-a9cc-e603357350ba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:13.734594 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-11786e2a-5ec1-43e1-a9cc-e603357350ba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:13.735323 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-11786e2a-5ec1-43e1-a9cc-e603357350ba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:13.736513 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-11786e2a-5ec1-43e1-a9cc-e603357350ba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:13.737826 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-11786e2a-5ec1-43e1-a9cc-e603357350ba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:13.798929 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d72de5ca-0dce-445a-b748-54afd4144aac tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:13.801688 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d72de5ca-0dce-445a-b748-54afd4144aac tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:13.814725 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d72de5ca-0dce-445a-b748-54afd4144aac tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:13.815838 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d72de5ca-0dce-445a-b748-54afd4144aac tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:13.817058 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d72de5ca-0dce-445a-b748-54afd4144aac tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:13.817859 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d72de5ca-0dce-445a-b748-54afd4144aac tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:14.077035 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-11786e2a-5ec1-43e1-a9cc-e603357350ba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:14.088483 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-11786e2a-5ec1-43e1-a9cc-e603357350ba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:14.094720 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-11786e2a-5ec1-43e1-a9cc-e603357350ba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:14.097216 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-11786e2a-5ec1-43e1-a9cc-e603357350ba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.378263 Jan 28 02:04:14.111517 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 248/494] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:13 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:14.145683 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d72de5ca-0dce-445a-b748-54afd4144aac tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:14.163301 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d72de5ca-0dce-445a-b748-54afd4144aac tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1511 microversion: 2.1 time: 0.371922 Jan 28 02:04:14.163969 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 247/495] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:13 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:14.183030 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-51391b31-3f0d-4a98-8778-eb7dfd74b57d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:14.184632 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-51391b31-3f0d-4a98-8778-eb7dfd74b57d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:14.191855 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-51391b31-3f0d-4a98-8778-eb7dfd74b57d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:14.192657 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-51391b31-3f0d-4a98-8778-eb7dfd74b57d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:14.193658 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-51391b31-3f0d-4a98-8778-eb7dfd74b57d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:14.194345 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-51391b31-3f0d-4a98-8778-eb7dfd74b57d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:14.442231 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-51391b31-3f0d-4a98-8778-eb7dfd74b57d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:14.455053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-51391b31-3f0d-4a98-8778-eb7dfd74b57d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.275414 Jan 28 02:04:14.456382 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 249/496] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:14 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:14.696439 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8a553388-aa3f-4b3b-bfd4-8f81c6ee0294 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:14.698362 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8a553388-aa3f-4b3b-bfd4-8f81c6ee0294 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:14.734950 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8a553388-aa3f-4b3b-bfd4-8f81c6ee0294 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:14.736561 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8a553388-aa3f-4b3b-bfd4-8f81c6ee0294 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:14.742427 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8a553388-aa3f-4b3b-bfd4-8f81c6ee0294 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:14.743452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8a553388-aa3f-4b3b-bfd4-8f81c6ee0294 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:15.039290 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8a553388-aa3f-4b3b-bfd4-8f81c6ee0294 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:15.075680 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8a553388-aa3f-4b3b-bfd4-8f81c6ee0294 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.386163 Jan 28 02:04:15.084242 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 248/497] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:14 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:15.118062 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-111c53f0-469e-439d-a9a6-57ee71b47e19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:15.119765 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-111c53f0-469e-439d-a9a6-57ee71b47e19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:15.131167 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-111c53f0-469e-439d-a9a6-57ee71b47e19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:15.140005 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-111c53f0-469e-439d-a9a6-57ee71b47e19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:15.141138 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-111c53f0-469e-439d-a9a6-57ee71b47e19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:15.141773 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-111c53f0-469e-439d-a9a6-57ee71b47e19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:15.186647 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5018a98b-9432-4226-93be-d2641399ba54 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:15.191536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5018a98b-9432-4226-93be-d2641399ba54 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:15.210929 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5018a98b-9432-4226-93be-d2641399ba54 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:15.218228 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5018a98b-9432-4226-93be-d2641399ba54 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:15.219549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5018a98b-9432-4226-93be-d2641399ba54 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:15.220245 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5018a98b-9432-4226-93be-d2641399ba54 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:15.730856 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-111c53f0-469e-439d-a9a6-57ee71b47e19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:15.748416 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-111c53f0-469e-439d-a9a6-57ee71b47e19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:15.757711 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-111c53f0-469e-439d-a9a6-57ee71b47e19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:15.765045 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-111c53f0-469e-439d-a9a6-57ee71b47e19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.651069 Jan 28 02:04:15.766156 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 250/498] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:15 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:15.777645 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ff3dd012-dd47-4b32-8ff3-7c3c3754171b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:15.783291 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ff3dd012-dd47-4b32-8ff3-7c3c3754171b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:15.795814 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff3dd012-dd47-4b32-8ff3-7c3c3754171b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:15.801929 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff3dd012-dd47-4b32-8ff3-7c3c3754171b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:15.803318 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff3dd012-dd47-4b32-8ff3-7c3c3754171b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:15.804020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ff3dd012-dd47-4b32-8ff3-7c3c3754171b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:15.812210 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5018a98b-9432-4226-93be-d2641399ba54 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:15.822746 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5018a98b-9432-4226-93be-d2641399ba54 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1511 microversion: 2.1 time: 0.640465 Jan 28 02:04:15.835217 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 249/499] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:15 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1511 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:16.100798 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-04da7598-0d33-414c-b1f4-c016c0fdce10 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:16.101863 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-04da7598-0d33-414c-b1f4-c016c0fdce10 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:16.113294 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04da7598-0d33-414c-b1f4-c016c0fdce10 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:16.118619 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04da7598-0d33-414c-b1f4-c016c0fdce10 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:16.119840 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04da7598-0d33-414c-b1f4-c016c0fdce10 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:16.120523 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04da7598-0d33-414c-b1f4-c016c0fdce10 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:16.847449 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ff3dd012-dd47-4b32-8ff3-7c3c3754171b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:16.861881 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ff3dd012-dd47-4b32-8ff3-7c3c3754171b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 1.087574 Jan 28 02:04:16.862601 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 251/500] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:15 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:16.869479 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-04da7598-0d33-414c-b1f4-c016c0fdce10 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:16.876301 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-3ed5cb5b-ba56-46d4-aaaf-41dc004c0d80 req-64ce4cb5-ea34-4977-bb22-206e25fda47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba343337-b8f3-4f63-875e-c13b7711e8bf", "name": "network-vif-deleted", "tag": "c105129e-5873-411f-b8e0-8fa24f669b60"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:16.878057 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:16.878057 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:04:16.900163 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-3ed5cb5b-ba56-46d4-aaaf-41dc004c0d80 req-64ce4cb5-ea34-4977-bb22-206e25fda47c service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:16.902922 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-3ed5cb5b-ba56-46d4-aaaf-41dc004c0d80 req-64ce4cb5-ea34-4977-bb22-206e25fda47c service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:16.906382 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-04da7598-0d33-414c-b1f4-c016c0fdce10 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.805553 Jan 28 02:04:16.909088 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 250/501] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:16 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:16.920939 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d7da6262-403a-4547-b2cf-fc4800a5e644 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:16.921953 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d7da6262-403a-4547-b2cf-fc4800a5e644 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:16.941685 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d7da6262-403a-4547-b2cf-fc4800a5e644 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:16.942807 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d7da6262-403a-4547-b2cf-fc4800a5e644 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:16.946126 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-3ed5cb5b-ba56-46d4-aaaf-41dc004c0d80 req-64ce4cb5-ea34-4977-bb22-206e25fda47c service nova] Creating event network-vif-deleted:c105129e-5873-411f-b8e0-8fa24f669b60 for instance ba343337-b8f3-4f63-875e-c13b7711e8bf on hv-cinder-82497 Jan 28 02:04:16.948138 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d7da6262-403a-4547-b2cf-fc4800a5e644 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:16.948585 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d7da6262-403a-4547-b2cf-fc4800a5e644 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:16.967208 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-3ed5cb5b-ba56-46d4-aaaf-41dc004c0d80 req-64ce4cb5-ea34-4977-bb22-206e25fda47c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102974 Jan 28 02:04:16.967862 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 252/502] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:16.993093 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3590282a-869a-4ea6-b99f-0a269b67e1b4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:16.994906 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3590282a-869a-4ea6-b99f-0a269b67e1b4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:17.051111 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3590282a-869a-4ea6-b99f-0a269b67e1b4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:17.051745 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3590282a-869a-4ea6-b99f-0a269b67e1b4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:17.052646 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3590282a-869a-4ea6-b99f-0a269b67e1b4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:17.053086 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3590282a-869a-4ea6-b99f-0a269b67e1b4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:17.173219 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3590282a-869a-4ea6-b99f-0a269b67e1b4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:17.173668 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3590282a-869a-4ea6-b99f-0a269b67e1b4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:17.177677 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-3590282a-869a-4ea6-b99f-0a269b67e1b4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lazy-loading 'fault' on Instance uuid ba343337-b8f3-4f63-875e-c13b7711e8bf {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:17.353133 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3590282a-869a-4ea6-b99f-0a269b67e1b4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:17.377695 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3590282a-869a-4ea6-b99f-0a269b67e1b4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 200 len: 1306 microversion: 2.1 time: 0.405445 Jan 28 02:04:17.387052 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 253/503] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:16 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 1306 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:17.618759 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d7da6262-403a-4547-b2cf-fc4800a5e644 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:17.650714 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d7da6262-403a-4547-b2cf-fc4800a5e644 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:17.653241 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d7da6262-403a-4547-b2cf-fc4800a5e644 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:17.660871 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d7da6262-403a-4547-b2cf-fc4800a5e644 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.747207 Jan 28 02:04:17.662453 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 251/504] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:16 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:17.882727 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4d653509-8218-4cd1-bdd7-7721dcb34b38 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:17.884652 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4d653509-8218-4cd1-bdd7-7721dcb34b38 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:17.898261 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4d653509-8218-4cd1-bdd7-7721dcb34b38 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:17.899909 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4d653509-8218-4cd1-bdd7-7721dcb34b38 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:17.904786 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4d653509-8218-4cd1-bdd7-7721dcb34b38 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:17.905974 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4d653509-8218-4cd1-bdd7-7721dcb34b38 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:17.925324 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ea9edcd8-2dea-4eb9-8151-99df31cf7131 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:17.926111 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ea9edcd8-2dea-4eb9-8151-99df31cf7131 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:17.939585 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea9edcd8-2dea-4eb9-8151-99df31cf7131 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:17.940137 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea9edcd8-2dea-4eb9-8151-99df31cf7131 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:17.941019 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea9edcd8-2dea-4eb9-8151-99df31cf7131 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:17.941705 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea9edcd8-2dea-4eb9-8151-99df31cf7131 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:18.214304 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4d653509-8218-4cd1-bdd7-7721dcb34b38 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:18.236448 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4d653509-8218-4cd1-bdd7-7721dcb34b38 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.358105 Jan 28 02:04:18.237038 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 254/505] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:17 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:18.367925 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ea9edcd8-2dea-4eb9-8151-99df31cf7131 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:18.382104 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ea9edcd8-2dea-4eb9-8151-99df31cf7131 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.460600 Jan 28 02:04:18.385207 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 252/506] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:17 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:18.415344 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-aeaea72f-2d3e-4517-9800-cc3401b71eaf tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:18.416117 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-aeaea72f-2d3e-4517-9800-cc3401b71eaf tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: ba343337-b8f3-4f63-875e-c13b7711e8bf] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:18.429937 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aeaea72f-2d3e-4517-9800-cc3401b71eaf tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:18.431649 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aeaea72f-2d3e-4517-9800-cc3401b71eaf tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:18.433887 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aeaea72f-2d3e-4517-9800-cc3401b71eaf tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:18.435013 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aeaea72f-2d3e-4517-9800-cc3401b71eaf tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:18.471433 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-aeaea72f-2d3e-4517-9800-cc3401b71eaf tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] HTTP exception thrown: Instance ba343337-b8f3-4f63-875e-c13b7711e8bf could not be found. Jan 28 02:04:18.473444 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-aeaea72f-2d3e-4517-9800-cc3401b71eaf tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Returning 404 to user: Instance ba343337-b8f3-4f63-875e-c13b7711e8bf could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:18.475160 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-aeaea72f-2d3e-4517-9800-cc3401b71eaf tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf" status: 404 len: 111 microversion: 2.1 time: 0.068019 Jan 28 02:04:18.476618 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 255/507] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:18 2022] GET /compute/v2.1/servers/ba343337-b8f3-4f63-875e-c13b7711e8bf => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:04:18.686201 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ec425827-8220-439c-9a65-ba315270a04c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:18.687239 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ec425827-8220-439c-9a65-ba315270a04c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:18.704844 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ec425827-8220-439c-9a65-ba315270a04c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:18.705975 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ec425827-8220-439c-9a65-ba315270a04c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:18.707390 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ec425827-8220-439c-9a65-ba315270a04c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:18.709080 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ec425827-8220-439c-9a65-ba315270a04c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.182127 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ec425827-8220-439c-9a65-ba315270a04c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:19.199987 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ec425827-8220-439c-9a65-ba315270a04c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:19.206640 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ec425827-8220-439c-9a65-ba315270a04c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:19.209514 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ec425827-8220-439c-9a65-ba315270a04c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.528798 Jan 28 02:04:19.226647 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 253/508] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:18 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:19.254589 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ac1add10-42fb-45c6-9fb1-af9f6fe64f24 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:19.255941 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ac1add10-42fb-45c6-9fb1-af9f6fe64f24 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:19.268071 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ac1add10-42fb-45c6-9fb1-af9f6fe64f24 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:19.268772 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ac1add10-42fb-45c6-9fb1-af9f6fe64f24 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.275241 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ac1add10-42fb-45c6-9fb1-af9f6fe64f24 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:19.275922 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ac1add10-42fb-45c6-9fb1-af9f6fe64f24 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.412577 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4721c725-feda-4496-9e67-c3510efef39b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:19.413600 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4721c725-feda-4496-9e67-c3510efef39b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:19.426293 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4721c725-feda-4496-9e67-c3510efef39b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:19.433513 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4721c725-feda-4496-9e67-c3510efef39b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.434920 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4721c725-feda-4496-9e67-c3510efef39b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:19.437112 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4721c725-feda-4496-9e67-c3510efef39b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.691960 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ac1add10-42fb-45c6-9fb1-af9f6fe64f24 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:19.704430 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ac1add10-42fb-45c6-9fb1-af9f6fe64f24 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.453896 Jan 28 02:04:19.705071 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 256/509] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:19 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:19.861764 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-507a019a-be0a-4a1c-abcd-3b25758c81eb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:19.862957 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-507a019a-be0a-4a1c-abcd-3b25758c81eb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:19.880235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-507a019a-be0a-4a1c-abcd-3b25758c81eb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:19.881311 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-507a019a-be0a-4a1c-abcd-3b25758c81eb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.882754 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-507a019a-be0a-4a1c-abcd-3b25758c81eb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:19.885226 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-507a019a-be0a-4a1c-abcd-3b25758c81eb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.901354 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4721c725-feda-4496-9e67-c3510efef39b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:19.918292 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4721c725-feda-4496-9e67-c3510efef39b tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.510349 Jan 28 02:04:19.921454 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 254/510] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:19 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:20.020851 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-507a019a-be0a-4a1c-abcd-3b25758c81eb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Going to try to terminate instance {{(pid=115761) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:04:20.234517 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-643a2f2b-03d4-49e8-a3d1-1731680fb561 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:20.235211 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-643a2f2b-03d4-49e8-a3d1-1731680fb561 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:20.247278 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-643a2f2b-03d4-49e8-a3d1-1731680fb561 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:20.252248 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-643a2f2b-03d4-49e8-a3d1-1731680fb561 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:20.254021 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-643a2f2b-03d4-49e8-a3d1-1731680fb561 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:20.254990 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-643a2f2b-03d4-49e8-a3d1-1731680fb561 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:20.285458 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-507a019a-be0a-4a1c-abcd-3b25758c81eb tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "DELETE /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 204 len: 0 microversion: 2.1 time: 0.427738 Jan 28 02:04:20.287632 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 257/511] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:04:19 2022] DELETE /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:04:20.303677 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d60d02cc-5e9c-4d19-87e5-42a09cb312b7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:20.304917 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d60d02cc-5e9c-4d19-87e5-42a09cb312b7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:20.321733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d60d02cc-5e9c-4d19-87e5-42a09cb312b7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:20.322679 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d60d02cc-5e9c-4d19-87e5-42a09cb312b7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:20.328019 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d60d02cc-5e9c-4d19-87e5-42a09cb312b7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:20.328990 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d60d02cc-5e9c-4d19-87e5-42a09cb312b7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:20.671486 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-643a2f2b-03d4-49e8-a3d1-1731680fb561 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:20.699194 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-643a2f2b-03d4-49e8-a3d1-1731680fb561 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:20.705210 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-643a2f2b-03d4-49e8-a3d1-1731680fb561 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:20.711285 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-643a2f2b-03d4-49e8-a3d1-1731680fb561 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.482359 Jan 28 02:04:20.730416 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 255/512] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:20 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:20.730643 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d60d02cc-5e9c-4d19-87e5-42a09cb312b7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:20.738864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d60d02cc-5e9c-4d19-87e5-42a09cb312b7 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1513 microversion: 2.1 time: 0.446481 Jan 28 02:04:20.739438 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 258/513] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:20 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1513 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:20.755049 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7fa74727-7674-47c7-8da6-1a05dcf4d36b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:20.759506 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7fa74727-7674-47c7-8da6-1a05dcf4d36b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:20.808768 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7fa74727-7674-47c7-8da6-1a05dcf4d36b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:20.811714 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7fa74727-7674-47c7-8da6-1a05dcf4d36b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:20.817099 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7fa74727-7674-47c7-8da6-1a05dcf4d36b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:20.820300 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7fa74727-7674-47c7-8da6-1a05dcf4d36b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:20.945986 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-498e16df-603d-45cb-93a4-d6ac45227e56 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:20.946610 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-498e16df-603d-45cb-93a4-d6ac45227e56 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:20.959019 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-498e16df-603d-45cb-93a4-d6ac45227e56 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:20.959824 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-498e16df-603d-45cb-93a4-d6ac45227e56 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:20.961270 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-498e16df-603d-45cb-93a4-d6ac45227e56 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:20.961797 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-498e16df-603d-45cb-93a4-d6ac45227e56 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:21.332809 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-498e16df-603d-45cb-93a4-d6ac45227e56 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:21.341810 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-498e16df-603d-45cb-93a4-d6ac45227e56 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.403244 Jan 28 02:04:21.347784 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 259/514] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:20 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:21.403924 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7fa74727-7674-47c7-8da6-1a05dcf4d36b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:21.416680 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7fa74727-7674-47c7-8da6-1a05dcf4d36b tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.684318 Jan 28 02:04:21.420901 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 256/515] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:20 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:21.739291 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-af91511f-8db7-4545-b08f-f969d8defcba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:21.740057 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-af91511f-8db7-4545-b08f-f969d8defcba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:21.755799 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-af91511f-8db7-4545-b08f-f969d8defcba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:21.756658 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-af91511f-8db7-4545-b08f-f969d8defcba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:21.757718 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-af91511f-8db7-4545-b08f-f969d8defcba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:21.765314 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a995d9c2-9203-446e-b1bb-965dca298b83 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:21.766173 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a995d9c2-9203-446e-b1bb-965dca298b83 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:21.768567 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-af91511f-8db7-4545-b08f-f969d8defcba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:21.783815 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a995d9c2-9203-446e-b1bb-965dca298b83 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:21.784796 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a995d9c2-9203-446e-b1bb-965dca298b83 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:21.786130 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a995d9c2-9203-446e-b1bb-965dca298b83 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:21.794522 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a995d9c2-9203-446e-b1bb-965dca298b83 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:22.098447 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a995d9c2-9203-446e-b1bb-965dca298b83 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:22.111560 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a995d9c2-9203-446e-b1bb-965dca298b83 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1513 microversion: 2.1 time: 0.350533 Jan 28 02:04:22.112572 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 257/516] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:21 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1513 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:22.112971 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-af91511f-8db7-4545-b08f-f969d8defcba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:22.125132 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-af91511f-8db7-4545-b08f-f969d8defcba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:22.133626 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-af91511f-8db7-4545-b08f-f969d8defcba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:22.143095 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-af91511f-8db7-4545-b08f-f969d8defcba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.404720 Jan 28 02:04:22.145002 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 260/517] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:21 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:22.377016 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-cd84dbb6-20c9-492f-98e6-5ac728a0f770 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:22.380234 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-cd84dbb6-20c9-492f-98e6-5ac728a0f770 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:22.401665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cd84dbb6-20c9-492f-98e6-5ac728a0f770 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:22.406790 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cd84dbb6-20c9-492f-98e6-5ac728a0f770 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:22.417131 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cd84dbb6-20c9-492f-98e6-5ac728a0f770 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:22.418497 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cd84dbb6-20c9-492f-98e6-5ac728a0f770 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:22.436845 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f5e04051-f557-4352-acec-452411153600 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:22.437681 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f5e04051-f557-4352-acec-452411153600 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:22.464789 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f5e04051-f557-4352-acec-452411153600 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:22.466297 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f5e04051-f557-4352-acec-452411153600 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:22.467965 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f5e04051-f557-4352-acec-452411153600 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:22.478858 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f5e04051-f557-4352-acec-452411153600 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:23.095054 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-cd84dbb6-20c9-492f-98e6-5ac728a0f770 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:23.101617 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f5e04051-f557-4352-acec-452411153600 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:23.111010 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f5e04051-f557-4352-acec-452411153600 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.678278 Jan 28 02:04:23.111261 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-cd84dbb6-20c9-492f-98e6-5ac728a0f770 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.741467 Jan 28 02:04:23.112312 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 258/518] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:22 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:23.118320 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 261/519] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:22 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:23.155297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ea105ab9-909f-444f-8173-d1572f7e2615 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:23.165590 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-46a8c491-2e32-4e1b-b9d6-4422cf2ac64d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:23.166531 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-46a8c491-2e32-4e1b-b9d6-4422cf2ac64d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:23.177164 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-46a8c491-2e32-4e1b-b9d6-4422cf2ac64d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:23.178182 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ea105ab9-909f-444f-8173-d1572f7e2615 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:23.182387 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-46a8c491-2e32-4e1b-b9d6-4422cf2ac64d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:23.184149 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-46a8c491-2e32-4e1b-b9d6-4422cf2ac64d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:23.190498 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-46a8c491-2e32-4e1b-b9d6-4422cf2ac64d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:23.201212 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea105ab9-909f-444f-8173-d1572f7e2615 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:23.210421 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea105ab9-909f-444f-8173-d1572f7e2615 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:23.215034 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea105ab9-909f-444f-8173-d1572f7e2615 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:23.222469 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea105ab9-909f-444f-8173-d1572f7e2615 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:23.489353 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-46a8c491-2e32-4e1b-b9d6-4422cf2ac64d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:23.509400 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-46a8c491-2e32-4e1b-b9d6-4422cf2ac64d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:23.510902 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ea105ab9-909f-444f-8173-d1572f7e2615 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:23.512342 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-46a8c491-2e32-4e1b-b9d6-4422cf2ac64d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:23.515532 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-46a8c491-2e32-4e1b-b9d6-4422cf2ac64d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.354400 Jan 28 02:04:23.529780 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ea105ab9-909f-444f-8173-d1572f7e2615 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1513 microversion: 2.1 time: 0.378150 Jan 28 02:04:23.529780 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 259/520] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:23 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1513 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:23.530228 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 262/521] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:23 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:24.133882 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d1d2d080-c308-4d43-ad09-282b48c21685 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:24.138349 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d1d2d080-c308-4d43-ad09-282b48c21685 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:24.161523 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0e5cda10-5eff-4720-b753-4b077814c808 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:24.163473 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0e5cda10-5eff-4720-b753-4b077814c808 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:24.183184 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d1d2d080-c308-4d43-ad09-282b48c21685 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:24.184312 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d1d2d080-c308-4d43-ad09-282b48c21685 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:24.190452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d1d2d080-c308-4d43-ad09-282b48c21685 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:24.192052 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d1d2d080-c308-4d43-ad09-282b48c21685 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:24.192931 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0e5cda10-5eff-4720-b753-4b077814c808 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:24.198254 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0e5cda10-5eff-4720-b753-4b077814c808 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:24.199505 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0e5cda10-5eff-4720-b753-4b077814c808 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:24.200150 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0e5cda10-5eff-4720-b753-4b077814c808 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:24.452079 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0e5cda10-5eff-4720-b753-4b077814c808 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:24.460634 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0e5cda10-5eff-4720-b753-4b077814c808 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.310760 Jan 28 02:04:24.461182 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 263/522] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:24 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:24.501341 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d1d2d080-c308-4d43-ad09-282b48c21685 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:24.512956 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d1d2d080-c308-4d43-ad09-282b48c21685 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.387851 Jan 28 02:04:24.543578 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 260/523] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:24 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:24.546808 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a33cd095-be9a-478c-9a56-b118e0bc1759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:24.547802 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a33cd095-be9a-478c-9a56-b118e0bc1759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:24.557379 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a33cd095-be9a-478c-9a56-b118e0bc1759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:24.558492 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a33cd095-be9a-478c-9a56-b118e0bc1759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:24.558920 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-71918a32-f134-40c2-8c38-8e252aeb6bc5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:24.560016 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-71918a32-f134-40c2-8c38-8e252aeb6bc5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:24.572046 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-71918a32-f134-40c2-8c38-8e252aeb6bc5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:24.574483 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-71918a32-f134-40c2-8c38-8e252aeb6bc5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:24.575469 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-71918a32-f134-40c2-8c38-8e252aeb6bc5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:24.577168 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a33cd095-be9a-478c-9a56-b118e0bc1759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:24.577782 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-71918a32-f134-40c2-8c38-8e252aeb6bc5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:24.577924 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a33cd095-be9a-478c-9a56-b118e0bc1759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:25.046124 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a33cd095-be9a-478c-9a56-b118e0bc1759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:25.057897 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a33cd095-be9a-478c-9a56-b118e0bc1759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:25.062245 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-71918a32-f134-40c2-8c38-8e252aeb6bc5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:25.067591 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a33cd095-be9a-478c-9a56-b118e0bc1759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:25.074644 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-71918a32-f134-40c2-8c38-8e252aeb6bc5 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1513 microversion: 2.1 time: 0.526307 Jan 28 02:04:25.077690 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a33cd095-be9a-478c-9a56-b118e0bc1759 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1738 microversion: 2.20 time: 0.538106 Jan 28 02:04:25.078299 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 264/524] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:24 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1738 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:25.086122 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 261/525] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:24 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1513 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:25.478734 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-0ac1b40a-9a46-43c4-9653-7daf03e40e62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:25.479911 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-0ac1b40a-9a46-43c4-9653-7daf03e40e62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:25.492976 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0ac1b40a-9a46-43c4-9653-7daf03e40e62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:25.496870 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0ac1b40a-9a46-43c4-9653-7daf03e40e62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:25.500724 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0ac1b40a-9a46-43c4-9653-7daf03e40e62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:25.501405 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0ac1b40a-9a46-43c4-9653-7daf03e40e62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:25.540730 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-02f0422c-9b84-4a33-8309-4ae700367194 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:25.541683 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-02f0422c-9b84-4a33-8309-4ae700367194 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:25.553417 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-02f0422c-9b84-4a33-8309-4ae700367194 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:25.554845 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-02f0422c-9b84-4a33-8309-4ae700367194 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:25.557221 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-02f0422c-9b84-4a33-8309-4ae700367194 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:25.559809 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-02f0422c-9b84-4a33-8309-4ae700367194 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:26.134302 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-02f0422c-9b84-4a33-8309-4ae700367194 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:26.135257 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-0ac1b40a-9a46-43c4-9653-7daf03e40e62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:26.181086 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-0ac1b40a-9a46-43c4-9653-7daf03e40e62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.705986 Jan 28 02:04:26.182751 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 262/526] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:25 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:26.184945 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-02f0422c-9b84-4a33-8309-4ae700367194 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.647603 Jan 28 02:04:26.200346 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 265/527] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:25 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:26.209867 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5e8a4950-d3dc-45b3-ae2c-0944d903b7a6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:26.211354 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5e8a4950-d3dc-45b3-ae2c-0944d903b7a6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:26.223897 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5e8a4950-d3dc-45b3-ae2c-0944d903b7a6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:26.225430 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5e8a4950-d3dc-45b3-ae2c-0944d903b7a6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:26.227017 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5e8a4950-d3dc-45b3-ae2c-0944d903b7a6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:26.227999 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5e8a4950-d3dc-45b3-ae2c-0944d903b7a6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:26.228282 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d79412e7-23a8-4556-b02b-eafef5f7ee2d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:26.228873 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d79412e7-23a8-4556-b02b-eafef5f7ee2d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:26.277554 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d79412e7-23a8-4556-b02b-eafef5f7ee2d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:26.278091 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d79412e7-23a8-4556-b02b-eafef5f7ee2d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:26.279557 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d79412e7-23a8-4556-b02b-eafef5f7ee2d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:26.280053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d79412e7-23a8-4556-b02b-eafef5f7ee2d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:26.400687 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5e8a4950-d3dc-45b3-ae2c-0944d903b7a6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:26.411053 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5e8a4950-d3dc-45b3-ae2c-0944d903b7a6 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 200 len: 1303 microversion: 2.1 time: 0.226361 Jan 28 02:04:26.412238 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 263/528] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:26 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 1303 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:26.417683 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-bfb3c172-bce6-44dc-b3ef-0c9ca95094f0 req-38aaa24f-c573-43f6-b7fd-19ea1fe79460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60cc0a8d-a1cc-413e-ba90-19e9507bcb4e", "name": "network-vif-deleted", "tag": "9c389827-57e0-481b-bae4-d3581c28a727"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:26.420364 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:26.420364 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:04:26.427851 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-bfb3c172-bce6-44dc-b3ef-0c9ca95094f0 req-38aaa24f-c573-43f6-b7fd-19ea1fe79460 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:26.428373 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-bfb3c172-bce6-44dc-b3ef-0c9ca95094f0 req-38aaa24f-c573-43f6-b7fd-19ea1fe79460 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:26.441717 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-bfb3c172-bce6-44dc-b3ef-0c9ca95094f0 req-38aaa24f-c573-43f6-b7fd-19ea1fe79460 service nova] Creating event network-vif-deleted:9c389827-57e0-481b-bae4-d3581c28a727 for instance 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e on hv-cinder-82497 Jan 28 02:04:26.447357 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-bfb3c172-bce6-44dc-b3ef-0c9ca95094f0 req-38aaa24f-c573-43f6-b7fd-19ea1fe79460 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033693 Jan 28 02:04:26.448541 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 264/529] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:26.520295 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d79412e7-23a8-4556-b02b-eafef5f7ee2d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:26.532027 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d79412e7-23a8-4556-b02b-eafef5f7ee2d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:26.534503 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d79412e7-23a8-4556-b02b-eafef5f7ee2d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:26.535953 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d79412e7-23a8-4556-b02b-eafef5f7ee2d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1720 microversion: 2.20 time: 0.345367 Jan 28 02:04:26.537203 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 266/530] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:26 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1720 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:27.202561 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d3c1d449-a459-400e-82f9-d2e01d0c24fe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:27.203982 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d3c1d449-a459-400e-82f9-d2e01d0c24fe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:27.209010 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0fc87785-dfdc-4929-b73c-ea9c12084e6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:27.209669 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0fc87785-dfdc-4929-b73c-ea9c12084e6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:27.217163 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0fc87785-dfdc-4929-b73c-ea9c12084e6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.217680 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0fc87785-dfdc-4929-b73c-ea9c12084e6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.218039 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d3c1d449-a459-400e-82f9-d2e01d0c24fe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.218416 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d3c1d449-a459-400e-82f9-d2e01d0c24fe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.218710 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0fc87785-dfdc-4929-b73c-ea9c12084e6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.219214 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d3c1d449-a459-400e-82f9-d2e01d0c24fe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.219975 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d3c1d449-a459-400e-82f9-d2e01d0c24fe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.220239 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0fc87785-dfdc-4929-b73c-ea9c12084e6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.541529 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d3c1d449-a459-400e-82f9-d2e01d0c24fe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:27.556256 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d3c1d449-a459-400e-82f9-d2e01d0c24fe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.358929 Jan 28 02:04:27.558279 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 265/531] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:27 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:27.562109 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0fc87785-dfdc-4929-b73c-ea9c12084e6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:27.566454 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-04ef52b1-35ee-496c-9ede-5ddfcf19dde4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:27.567639 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-04ef52b1-35ee-496c-9ede-5ddfcf19dde4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:27.570332 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0fc87785-dfdc-4929-b73c-ea9c12084e6f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1567 microversion: 2.1 time: 0.365005 Jan 28 02:04:27.580199 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 267/532] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:27 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1567 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:27.580199 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6a39a223-1404-4534-a54a-829b52774bb9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:27.580199 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6a39a223-1404-4534-a54a-829b52774bb9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:27.583193 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6a39a223-1404-4534-a54a-829b52774bb9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.583636 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6a39a223-1404-4534-a54a-829b52774bb9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.584531 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6a39a223-1404-4534-a54a-829b52774bb9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.584960 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6a39a223-1404-4534-a54a-829b52774bb9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.585920 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04ef52b1-35ee-496c-9ede-5ddfcf19dde4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.586585 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04ef52b1-35ee-496c-9ede-5ddfcf19dde4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.587707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04ef52b1-35ee-496c-9ede-5ddfcf19dde4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.588290 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04ef52b1-35ee-496c-9ede-5ddfcf19dde4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.616290 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-04ef52b1-35ee-496c-9ede-5ddfcf19dde4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] HTTP exception thrown: Instance 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e could not be found. Jan 28 02:04:27.618013 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-04ef52b1-35ee-496c-9ede-5ddfcf19dde4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Returning 404 to user: Instance 60cc0a8d-a1cc-413e-ba90-19e9507bcb4e could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:27.624845 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-04ef52b1-35ee-496c-9ede-5ddfcf19dde4 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e" status: 404 len: 111 microversion: 2.1 time: 0.064830 Jan 28 02:04:27.626655 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 266/533] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:27 2022] GET /compute/v2.1/servers/60cc0a8d-a1cc-413e-ba90-19e9507bcb4e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:04:27.635582 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a1d2d90c-f659-456c-a77a-85d985da512f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:27.636759 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a1d2d90c-f659-456c-a77a-85d985da512f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:27.644846 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a1d2d90c-f659-456c-a77a-85d985da512f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.645677 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a1d2d90c-f659-456c-a77a-85d985da512f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.646922 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a1d2d90c-f659-456c-a77a-85d985da512f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.647578 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a1d2d90c-f659-456c-a77a-85d985da512f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.700991 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a1d2d90c-f659-456c-a77a-85d985da512f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:04:27.777253 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6a39a223-1404-4534-a54a-829b52774bb9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:27.796645 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6a39a223-1404-4534-a54a-829b52774bb9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:27.800110 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6a39a223-1404-4534-a54a-829b52774bb9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:27.802273 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6a39a223-1404-4534-a54a-829b52774bb9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1720 microversion: 2.20 time: 0.229133 Jan 28 02:04:27.803144 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 268/534] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:27 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:27.813989 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a1d2d90c-f659-456c-a77a-85d985da512f tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 204 len: 0 microversion: 2.1 time: 0.181932 Jan 28 02:04:27.816844 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 267/535] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:04:27 2022] DELETE /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:04:27.827192 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-734f8c95-7f4c-425f-bb0f-df07cf3c3d02 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:27.827813 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-734f8c95-7f4c-425f-bb0f-df07cf3c3d02 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:27.834788 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-734f8c95-7f4c-425f-bb0f-df07cf3c3d02 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.835248 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-734f8c95-7f4c-425f-bb0f-df07cf3c3d02 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.836033 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-734f8c95-7f4c-425f-bb0f-df07cf3c3d02 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.836500 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-734f8c95-7f4c-425f-bb0f-df07cf3c3d02 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.985811 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-734f8c95-7f4c-425f-bb0f-df07cf3c3d02 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:27.993633 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-734f8c95-7f4c-425f-bb0f-df07cf3c3d02 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1510 microversion: 2.1 time: 0.172042 Jan 28 02:04:27.994272 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 269/536] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:27 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:28.576389 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-67906792-6b98-4f0b-98e3-ac302ba84219 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:28.577015 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-67906792-6b98-4f0b-98e3-ac302ba84219 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:28.588249 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a7178264-96ed-4e8c-b90b-4063a8480d43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:28.589524 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a7178264-96ed-4e8c-b90b-4063a8480d43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:28.600437 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7178264-96ed-4e8c-b90b-4063a8480d43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:28.601392 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-67906792-6b98-4f0b-98e3-ac302ba84219 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:28.602211 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-67906792-6b98-4f0b-98e3-ac302ba84219 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:28.603916 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-67906792-6b98-4f0b-98e3-ac302ba84219 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:28.604739 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7178264-96ed-4e8c-b90b-4063a8480d43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:28.605420 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-67906792-6b98-4f0b-98e3-ac302ba84219 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:28.609505 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7178264-96ed-4e8c-b90b-4063a8480d43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:28.610313 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a7178264-96ed-4e8c-b90b-4063a8480d43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:28.916497 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-67906792-6b98-4f0b-98e3-ac302ba84219 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:28.934375 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-67906792-6b98-4f0b-98e3-ac302ba84219 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.361984 Jan 28 02:04:28.944640 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a7178264-96ed-4e8c-b90b-4063a8480d43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:28.945246 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 268/537] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:28 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:28.950320 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-bfe92d25-d9f1-45eb-9326-07be9f9da2d0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:28.951612 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-bfe92d25-d9f1-45eb-9326-07be9f9da2d0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:28.952917 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a7178264-96ed-4e8c-b90b-4063a8480d43 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1547 microversion: 2.1 time: 0.368302 Jan 28 02:04:28.964915 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 270/538] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:28 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1547 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:28.971677 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a744cd30-7abf-4185-959a-2cb3f8d9917a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:28.971979 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bfe92d25-d9f1-45eb-9326-07be9f9da2d0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:28.972587 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bfe92d25-d9f1-45eb-9326-07be9f9da2d0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:28.972723 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a744cd30-7abf-4185-959a-2cb3f8d9917a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:28.973692 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bfe92d25-d9f1-45eb-9326-07be9f9da2d0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:28.974303 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bfe92d25-d9f1-45eb-9326-07be9f9da2d0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:28.989298 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a744cd30-7abf-4185-959a-2cb3f8d9917a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:28.989767 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a744cd30-7abf-4185-959a-2cb3f8d9917a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:28.991462 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a744cd30-7abf-4185-959a-2cb3f8d9917a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:28.993525 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a744cd30-7abf-4185-959a-2cb3f8d9917a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.146028 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-a744cd30-7abf-4185-959a-2cb3f8d9917a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] HTTP exception thrown: Cannot 'detach_volume' instance 706d03a1-cf66-4cdb-8271-bb94ca669ad7 while it is in vm_state rescued Jan 28 02:04:29.146630 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a744cd30-7abf-4185-959a-2cb3f8d9917a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Returning 409 to user: Cannot 'detach_volume' instance 706d03a1-cf66-4cdb-8271-bb94ca669ad7 while it is in vm_state rescued {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:29.147473 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a744cd30-7abf-4185-959a-2cb3f8d9917a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "DELETE /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/os-volume_attachments/d31382bb-997b-4e95-9e68-aea8679d4263" status: 409 len: 152 microversion: 2.1 time: 0.180907 Jan 28 02:04:29.154650 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 271/539] 10.222.0.77 () {58 vars in 1415 bytes} [Fri Jan 28 02:04:28 2022] DELETE /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/os-volume_attachments/d31382bb-997b-4e95-9e68-aea8679d4263 => generated 152 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 02:04:29.160683 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7fc2a410-6f8b-4d3c-9680-eadab295694e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:29.161236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7fc2a410-6f8b-4d3c-9680-eadab295694e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:29.173199 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7fc2a410-6f8b-4d3c-9680-eadab295694e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:29.175064 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7fc2a410-6f8b-4d3c-9680-eadab295694e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.177791 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7fc2a410-6f8b-4d3c-9680-eadab295694e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:29.178706 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7fc2a410-6f8b-4d3c-9680-eadab295694e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.211659 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bfe92d25-d9f1-45eb-9326-07be9f9da2d0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:29.224153 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bfe92d25-d9f1-45eb-9326-07be9f9da2d0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:29.227538 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bfe92d25-d9f1-45eb-9326-07be9f9da2d0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:29.231801 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-bfe92d25-d9f1-45eb-9326-07be9f9da2d0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1723 microversion: 2.20 time: 0.285196 Jan 28 02:04:29.251236 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 269/540] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:28 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:29.264617 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4e08480b-8e8a-404f-801c-10eac67bb60c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:29.267062 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4e08480b-8e8a-404f-801c-10eac67bb60c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:29.283227 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4e08480b-8e8a-404f-801c-10eac67bb60c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:29.284743 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4e08480b-8e8a-404f-801c-10eac67bb60c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.290589 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4e08480b-8e8a-404f-801c-10eac67bb60c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:29.291316 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4e08480b-8e8a-404f-801c-10eac67bb60c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.416429 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7fc2a410-6f8b-4d3c-9680-eadab295694e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:29.428433 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7fc2a410-6f8b-4d3c-9680-eadab295694e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1510 microversion: 2.1 time: 0.272640 Jan 28 02:04:29.429172 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 272/541] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:29 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:29.449441 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-989c72f8-348d-43f0-bfcf-bfd4274f7164 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18335c75-9d5b-4fbb-9916-cd9d63977fc9"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:29.453031 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-989c72f8-348d-43f0-bfcf-bfd4274f7164 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:29.469510 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-989c72f8-348d-43f0-bfcf-bfd4274f7164 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:29.470678 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-989c72f8-348d-43f0-bfcf-bfd4274f7164 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.480315 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-989c72f8-348d-43f0-bfcf-bfd4274f7164 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:29.483446 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4e08480b-8e8a-404f-801c-10eac67bb60c tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "POST /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/action" status: 202 len: 0 microversion: 2.1 time: 0.229247 Jan 28 02:04:29.484163 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-989c72f8-348d-43f0-bfcf-bfd4274f7164 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.492872 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 270/542] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:04:29 2022] POST /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:04:29.509006 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6b71d931-a4ad-4e37-b088-e7dae2f69e13 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:29.512472 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6b71d931-a4ad-4e37-b088-e7dae2f69e13 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:29.524939 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b71d931-a4ad-4e37-b088-e7dae2f69e13 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:29.525668 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b71d931-a4ad-4e37-b088-e7dae2f69e13 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.527112 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b71d931-a4ad-4e37-b088-e7dae2f69e13 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:29.527948 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b71d931-a4ad-4e37-b088-e7dae2f69e13 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.761022 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6b71d931-a4ad-4e37-b088-e7dae2f69e13 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:29.772593 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6b71d931-a4ad-4e37-b088-e7dae2f69e13 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1555 microversion: 2.1 time: 0.276485 Jan 28 02:04:29.784826 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 271/543] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:29 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1555 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:29.811880 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-be885739-2b4e-4532-a1db-3ac3323b4970 req-e7884a52-8800-4bba-ab37-ba081936f8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d048580-813a-43b7-ae1a-e0b1a9c8c234", "name": "network-vif-unplugged", "status": "completed", "tag": "1c3eebfc-cf3d-4a86-8be4-2f39da195acf"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:29.814736 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:29.814736 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:04:29.823059 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-be885739-2b4e-4532-a1db-3ac3323b4970 req-e7884a52-8800-4bba-ab37-ba081936f8a4 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:29.823749 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-be885739-2b4e-4532-a1db-3ac3323b4970 req-e7884a52-8800-4bba-ab37-ba081936f8a4 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.838688 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.compute.server_external_events [req-be885739-2b4e-4532-a1db-3ac3323b4970 req-e7884a52-8800-4bba-ab37-ba081936f8a4 service nova] Unable to find a host for instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234. Dropping event network-vif-unplugged {{(pid=115760) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 28 02:04:29.840114 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-be885739-2b4e-4532-a1db-3ac3323b4970 req-e7884a52-8800-4bba-ab37-ba081936f8a4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054022 Jan 28 02:04:29.843855 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 272/544] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 58 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 28 02:04:29.967649 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3fee67ac-e87b-49b1-b5d0-2e3381ad49b0 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:29.968324 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3fee67ac-e87b-49b1-b5d0-2e3381ad49b0 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:29.994260 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3fee67ac-e87b-49b1-b5d0-2e3381ad49b0 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:29.996050 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3fee67ac-e87b-49b1-b5d0-2e3381ad49b0 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.998186 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-989c72f8-348d-43f0-bfcf-bfd4274f7164 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.566934 Jan 28 02:04:29.999804 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 273/545] 10.222.0.77 () {62 vars in 1363 bytes} [Fri Jan 28 02:04:29 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/os-volume_attachments => generated 188 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:04:30.002128 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3fee67ac-e87b-49b1-b5d0-2e3381ad49b0 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:30.002975 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3fee67ac-e87b-49b1-b5d0-2e3381ad49b0 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:30.220512 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-3fee67ac-e87b-49b1-b5d0-2e3381ad49b0 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:30.229297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3fee67ac-e87b-49b1-b5d0-2e3381ad49b0 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.274052 Jan 28 02:04:30.230254 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 273/546] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:29 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:30.235616 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e881225e-2366-409b-934e-8506b7b0a6b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:30.236520 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e881225e-2366-409b-934e-8506b7b0a6b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:30.243884 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e881225e-2366-409b-934e-8506b7b0a6b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:30.244628 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e881225e-2366-409b-934e-8506b7b0a6b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:30.245893 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e881225e-2366-409b-934e-8506b7b0a6b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:30.246549 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e881225e-2366-409b-934e-8506b7b0a6b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:30.460747 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-46a2603b-110c-4d5d-963c-cdc60c193532 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:30.461690 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-46a2603b-110c-4d5d-963c-cdc60c193532 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:30.492929 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-46a2603b-110c-4d5d-963c-cdc60c193532 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:30.493606 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-46a2603b-110c-4d5d-963c-cdc60c193532 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:30.497568 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-46a2603b-110c-4d5d-963c-cdc60c193532 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:30.498951 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-46a2603b-110c-4d5d-963c-cdc60c193532 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:30.523908 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e881225e-2366-409b-934e-8506b7b0a6b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action" status: 202 len: 0 microversion: 2.20 time: 0.290570 Jan 28 02:04:30.526647 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 274/547] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:04:30 2022] POST /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:04:30.549558 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e5998d63-a6d4-4587-8f9f-c5597fcc9360 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:30.556370 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e5998d63-a6d4-4587-8f9f-c5597fcc9360 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:30.580534 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e5998d63-a6d4-4587-8f9f-c5597fcc9360 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:30.590010 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e5998d63-a6d4-4587-8f9f-c5597fcc9360 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:30.596226 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e5998d63-a6d4-4587-8f9f-c5597fcc9360 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:30.598110 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e5998d63-a6d4-4587-8f9f-c5597fcc9360 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:30.694201 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-46a2603b-110c-4d5d-963c-cdc60c193532 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:30.705644 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-46a2603b-110c-4d5d-963c-cdc60c193532 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 200 len: 1468 microversion: 2.1 time: 0.252857 Jan 28 02:04:30.715014 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 274/548] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:30 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 1468 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:30.735555 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-48dee20c-33d1-4d01-8a8c-9d58f2be4b15 req-883dd2b8-8953-4631-8bc0-5ac52e1b054f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4151aa9-3199-4737-9677-a6eb2d6237df", "name": "network-vif-deleted", "tag": "bad03cd4-410c-4cad-9815-8cc25c949359"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:30.737466 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:30.737466 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:04:30.746767 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-48dee20c-33d1-4d01-8a8c-9d58f2be4b15 req-883dd2b8-8953-4631-8bc0-5ac52e1b054f service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:30.747971 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-48dee20c-33d1-4d01-8a8c-9d58f2be4b15 req-883dd2b8-8953-4631-8bc0-5ac52e1b054f service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:30.772271 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-48dee20c-33d1-4d01-8a8c-9d58f2be4b15 req-883dd2b8-8953-4631-8bc0-5ac52e1b054f service nova] Creating event network-vif-deleted:bad03cd4-410c-4cad-9815-8cc25c949359 for instance c4151aa9-3199-4737-9677-a6eb2d6237df on hv-cinder-82497 Jan 28 02:04:30.786295 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-48dee20c-33d1-4d01-8a8c-9d58f2be4b15 req-883dd2b8-8953-4631-8bc0-5ac52e1b054f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066711 Jan 28 02:04:30.790236 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 275/549] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:30.803177 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c9f2a411-2333-43d7-b741-2eab64c2a821 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:30.804189 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c9f2a411-2333-43d7-b741-2eab64c2a821 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:30.819462 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c9f2a411-2333-43d7-b741-2eab64c2a821 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:30.820052 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c9f2a411-2333-43d7-b741-2eab64c2a821 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:30.820935 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c9f2a411-2333-43d7-b741-2eab64c2a821 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:30.821920 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c9f2a411-2333-43d7-b741-2eab64c2a821 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:30.843779 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e5998d63-a6d4-4587-8f9f-c5597fcc9360 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:30.860840 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e5998d63-a6d4-4587-8f9f-c5597fcc9360 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:30.864099 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e5998d63-a6d4-4587-8f9f-c5597fcc9360 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:30.866607 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e5998d63-a6d4-4587-8f9f-c5597fcc9360 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1749 microversion: 2.20 time: 0.335971 Jan 28 02:04:30.867985 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 275/550] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:30 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1749 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:31.070101 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c9f2a411-2333-43d7-b741-2eab64c2a821 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:31.083255 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c9f2a411-2333-43d7-b741-2eab64c2a821 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1555 microversion: 2.1 time: 0.291271 Jan 28 02:04:31.085237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 276/551] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:30 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:31.262755 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-fe1287df-ee94-4975-91e2-017d8ac443d7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:31.264355 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-fe1287df-ee94-4975-91e2-017d8ac443d7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:31.282747 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fe1287df-ee94-4975-91e2-017d8ac443d7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:31.283553 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fe1287df-ee94-4975-91e2-017d8ac443d7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:31.284566 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fe1287df-ee94-4975-91e2-017d8ac443d7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:31.285197 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fe1287df-ee94-4975-91e2-017d8ac443d7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:31.521572 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-fe1287df-ee94-4975-91e2-017d8ac443d7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:31.540734 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-fe1287df-ee94-4975-91e2-017d8ac443d7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.296011 Jan 28 02:04:31.541322 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 276/552] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:31 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:31.723245 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-46a70d84-41f0-4529-8720-1646f8122443 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:31.724050 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-46a70d84-41f0-4529-8720-1646f8122443 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: c4151aa9-3199-4737-9677-a6eb2d6237df] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:31.732236 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-46a70d84-41f0-4529-8720-1646f8122443 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:31.732831 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-46a70d84-41f0-4529-8720-1646f8122443 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:31.733610 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-46a70d84-41f0-4529-8720-1646f8122443 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:31.734078 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-46a70d84-41f0-4529-8720-1646f8122443 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:31.749530 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-46a70d84-41f0-4529-8720-1646f8122443 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] HTTP exception thrown: Instance c4151aa9-3199-4737-9677-a6eb2d6237df could not be found. Jan 28 02:04:31.750243 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-46a70d84-41f0-4529-8720-1646f8122443 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Returning 404 to user: Instance c4151aa9-3199-4737-9677-a6eb2d6237df could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:31.750977 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-46a70d84-41f0-4529-8720-1646f8122443 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df" status: 404 len: 111 microversion: 2.1 time: 0.032087 Jan 28 02:04:31.751514 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 277/553] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:31 2022] GET /compute/v2.1/servers/c4151aa9-3199-4737-9677-a6eb2d6237df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:04:31.859985 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-24640fef-8e99-4dca-b6e7-18ed873589f9 req-9d6ed955-6771-4324-bac2-0bb9b9bd2e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99e0d03-1fe8-4dd7-9c5d-e67a633ab920", "name": "network-vif-plugged", "status": "completed", "tag": "df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:31.861822 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:31.861822 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:04:31.868962 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-24640fef-8e99-4dca-b6e7-18ed873589f9 req-9d6ed955-6771-4324-bac2-0bb9b9bd2e81 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:31.869407 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-24640fef-8e99-4dca-b6e7-18ed873589f9 req-9d6ed955-6771-4324-bac2-0bb9b9bd2e81 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:31.886071 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-094a0b80-ff51-4eee-8431-83726ea41235 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:31.887284 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-094a0b80-ff51-4eee-8431-83726ea41235 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:31.893437 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-094a0b80-ff51-4eee-8431-83726ea41235 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:31.894011 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-094a0b80-ff51-4eee-8431-83726ea41235 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:31.894676 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-094a0b80-ff51-4eee-8431-83726ea41235 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:31.895096 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-094a0b80-ff51-4eee-8431-83726ea41235 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:31.918938 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-24640fef-8e99-4dca-b6e7-18ed873589f9 req-9d6ed955-6771-4324-bac2-0bb9b9bd2e81 service nova] Creating event network-vif-plugged:df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1 for instance b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 on hv-cinder-82497 Jan 28 02:04:31.927471 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-24640fef-8e99-4dca-b6e7-18ed873589f9 req-9d6ed955-6771-4324-bac2-0bb9b9bd2e81 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073172 Jan 28 02:04:31.937065 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 277/554] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:32.072244 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-094a0b80-ff51-4eee-8431-83726ea41235 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:32.082117 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-094a0b80-ff51-4eee-8431-83726ea41235 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:32.083780 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-094a0b80-ff51-4eee-8431-83726ea41235 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:32.086204 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-094a0b80-ff51-4eee-8431-83726ea41235 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1749 microversion: 2.20 time: 0.203585 Jan 28 02:04:32.087179 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 278/555] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:31 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1749 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:32.109191 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7e3202c5-da5e-4fab-b682-f76c517e3a51 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:32.110020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7e3202c5-da5e-4fab-b682-f76c517e3a51 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:32.123053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7e3202c5-da5e-4fab-b682-f76c517e3a51 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:32.124096 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7e3202c5-da5e-4fab-b682-f76c517e3a51 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:32.129055 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7e3202c5-da5e-4fab-b682-f76c517e3a51 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:32.129499 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7e3202c5-da5e-4fab-b682-f76c517e3a51 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:32.357740 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7e3202c5-da5e-4fab-b682-f76c517e3a51 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:32.366585 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7e3202c5-da5e-4fab-b682-f76c517e3a51 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1555 microversion: 2.1 time: 0.262121 Jan 28 02:04:32.367150 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 278/556] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:32 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1555 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:32.557842 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-720ee00b-6273-48b0-a67d-bd5cd8f3aaf2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:32.559122 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-720ee00b-6273-48b0-a67d-bd5cd8f3aaf2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:32.567239 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-720ee00b-6273-48b0-a67d-bd5cd8f3aaf2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:32.567947 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-720ee00b-6273-48b0-a67d-bd5cd8f3aaf2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:32.569283 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-720ee00b-6273-48b0-a67d-bd5cd8f3aaf2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:32.570190 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-720ee00b-6273-48b0-a67d-bd5cd8f3aaf2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:32.705553 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-720ee00b-6273-48b0-a67d-bd5cd8f3aaf2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:32.714441 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-720ee00b-6273-48b0-a67d-bd5cd8f3aaf2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1359 microversion: 2.1 time: 0.160490 Jan 28 02:04:32.724677 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 279/557] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:32 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:32.975130 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f12718ac-ae2d-41cd-9cda-4841dc2f5d2e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:32.975622 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f12718ac-ae2d-41cd-9cda-4841dc2f5d2e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:32.981412 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f12718ac-ae2d-41cd-9cda-4841dc2f5d2e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:32.982674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f12718ac-ae2d-41cd-9cda-4841dc2f5d2e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:32.984591 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f12718ac-ae2d-41cd-9cda-4841dc2f5d2e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:32.985681 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f12718ac-ae2d-41cd-9cda-4841dc2f5d2e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.017187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f12718ac-ae2d-41cd-9cda-4841dc2f5d2e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Going to try to terminate instance {{(pid=115761) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:04:33.096420 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f12718ac-ae2d-41cd-9cda-4841dc2f5d2e tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 204 len: 0 microversion: 2.1 time: 0.124816 Jan 28 02:04:33.097160 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 279/558] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:04:32 2022] DELETE /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:04:33.109262 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-57539263-6756-4837-afff-7f508d669aba tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:33.110592 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-57539263-6756-4837-afff-7f508d669aba tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:33.116836 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-57539263-6756-4837-afff-7f508d669aba tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.117550 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-57539263-6756-4837-afff-7f508d669aba tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.118536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-57539263-6756-4837-afff-7f508d669aba tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.119156 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-57539263-6756-4837-afff-7f508d669aba tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.120841 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bf1172a0-f70f-419c-bd30-b4d260f95539 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:33.122447 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bf1172a0-f70f-419c-bd30-b4d260f95539 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:33.135815 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bf1172a0-f70f-419c-bd30-b4d260f95539 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.136615 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bf1172a0-f70f-419c-bd30-b4d260f95539 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.142325 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bf1172a0-f70f-419c-bd30-b4d260f95539 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.142786 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bf1172a0-f70f-419c-bd30-b4d260f95539 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.313540 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-57539263-6756-4837-afff-7f508d669aba tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:33.324793 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-57539263-6756-4837-afff-7f508d669aba tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1512 microversion: 2.1 time: 0.221626 Jan 28 02:04:33.327456 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 280/559] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:33 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:33.360441 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-bf1172a0-f70f-419c-bd30-b4d260f95539 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:33.370468 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-bf1172a0-f70f-419c-bd30-b4d260f95539 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:33.372894 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-bf1172a0-f70f-419c-bd30-b4d260f95539 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:33.374793 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-bf1172a0-f70f-419c-bd30-b4d260f95539 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1751 microversion: 2.20 time: 0.264908 Jan 28 02:04:33.375885 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 280/560] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:33 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1751 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:33.384652 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ccb3a095-64ef-4910-8460-2742f1517db5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:33.385499 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ccb3a095-64ef-4910-8460-2742f1517db5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:33.394789 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ccb3a095-64ef-4910-8460-2742f1517db5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.395603 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ccb3a095-64ef-4910-8460-2742f1517db5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.396613 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ccb3a095-64ef-4910-8460-2742f1517db5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.397673 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ccb3a095-64ef-4910-8460-2742f1517db5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.559457 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ccb3a095-64ef-4910-8460-2742f1517db5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:33.569787 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ccb3a095-64ef-4910-8460-2742f1517db5 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1561 microversion: 2.1 time: 0.189072 Jan 28 02:04:33.577865 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 281/561] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:33 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1561 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:33.675107 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ae257956-6f86-4aba-a8ad-6b8a7bcbbe1e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:33.676178 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ae257956-6f86-4aba-a8ad-6b8a7bcbbe1e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:33.694516 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ae257956-6f86-4aba-a8ad-6b8a7bcbbe1e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.695181 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ae257956-6f86-4aba-a8ad-6b8a7bcbbe1e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.697495 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ae257956-6f86-4aba-a8ad-6b8a7bcbbe1e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.698080 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ae257956-6f86-4aba-a8ad-6b8a7bcbbe1e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.733162 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a1547e63-8cda-4812-8c90-8c473d09efaa tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:33.734451 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a1547e63-8cda-4812-8c90-8c473d09efaa tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:33.743740 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a1547e63-8cda-4812-8c90-8c473d09efaa tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.744187 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a1547e63-8cda-4812-8c90-8c473d09efaa tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.744976 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a1547e63-8cda-4812-8c90-8c473d09efaa tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.745418 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a1547e63-8cda-4812-8c90-8c473d09efaa tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.845986 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-ae257956-6f86-4aba-a8ad-6b8a7bcbbe1e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lazy-loading 'services' on Instance uuid 706d03a1-cf66-4cdb-8271-bb94ca669ad7 {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:33.920162 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a1547e63-8cda-4812-8c90-8c473d09efaa tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:33.930951 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a1547e63-8cda-4812-8c90-8c473d09efaa tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1550 microversion: 2.1 time: 0.202468 Jan 28 02:04:33.932075 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 282/562] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:33 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1550 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:33.946650 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ae257956-6f86-4aba-a8ad-6b8a7bcbbe1e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "DELETE /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/os-volume_attachments/d31382bb-997b-4e95-9e68-aea8679d4263" status: 202 len: 0 microversion: 2.1 time: 0.261600 Jan 28 02:04:33.947646 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 281/563] 10.222.0.77 () {58 vars in 1415 bytes} [Fri Jan 28 02:04:33 2022] DELETE /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/os-volume_attachments/d31382bb-997b-4e95-9e68-aea8679d4263 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:04:33.956198 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d46e8d0f-6888-4052-a548-4167fcc1bc25 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:33.957080 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d46e8d0f-6888-4052-a548-4167fcc1bc25 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:33.963501 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-526978c2-b2f2-4fc5-83a9-620fc0dcd0e0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:33.965221 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-526978c2-b2f2-4fc5-83a9-620fc0dcd0e0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:33.966857 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d46e8d0f-6888-4052-a548-4167fcc1bc25 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.967875 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d46e8d0f-6888-4052-a548-4167fcc1bc25 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.969019 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d46e8d0f-6888-4052-a548-4167fcc1bc25 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.969607 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d46e8d0f-6888-4052-a548-4167fcc1bc25 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.976171 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-526978c2-b2f2-4fc5-83a9-620fc0dcd0e0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.977005 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-526978c2-b2f2-4fc5-83a9-620fc0dcd0e0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.978975 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-526978c2-b2f2-4fc5-83a9-620fc0dcd0e0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.979733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-526978c2-b2f2-4fc5-83a9-620fc0dcd0e0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:34.041532 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-526978c2-b2f2-4fc5-83a9-620fc0dcd0e0 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087183 Jan 28 02:04:34.049717 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 282/564] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:04:33 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:34.143347 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d46e8d0f-6888-4052-a548-4167fcc1bc25 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:34.152763 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d46e8d0f-6888-4052-a548-4167fcc1bc25 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1550 microversion: 2.1 time: 0.204656 Jan 28 02:04:34.154475 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 283/565] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:33 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1550 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:34.175640 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-68d7fe1f-00f6-47c5-a890-d58d901d9bf7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:34.181000 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:34.181000 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:04:34.182546 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-68d7fe1f-00f6-47c5-a890-d58d901d9bf7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:34.183481 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-68d7fe1f-00f6-47c5-a890-d58d901d9bf7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Searching by: {'deleted': False, 'project_id': '8f948307a28a46c882d15550cc527d3e'} {{(pid=115761) get_all /opt/stack/nova/nova/compute/api.py:2905}} Jan 28 02:04:34.193464 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-68d7fe1f-00f6-47c5-a890-d58d901d9bf7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:34.193940 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-68d7fe1f-00f6-47c5-a890-d58d901d9bf7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:34.194740 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-68d7fe1f-00f6-47c5-a890-d58d901d9bf7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:34.195170 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-68d7fe1f-00f6-47c5-a890-d58d901d9bf7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:34.347481 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ffeb8d55-6389-4903-8721-aeb9dbdb6555 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:34.348232 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ffeb8d55-6389-4903-8721-aeb9dbdb6555 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:34.367194 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ffeb8d55-6389-4903-8721-aeb9dbdb6555 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:34.367640 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ffeb8d55-6389-4903-8721-aeb9dbdb6555 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:34.368423 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ffeb8d55-6389-4903-8721-aeb9dbdb6555 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:34.368847 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ffeb8d55-6389-4903-8721-aeb9dbdb6555 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:34.473212 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.multi_cell_list [None req-68d7fe1f-00f6-47c5-a890-d58d901d9bf7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115761) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jan 28 02:04:34.624102 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ffeb8d55-6389-4903-8721-aeb9dbdb6555 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:34.631953 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ffeb8d55-6389-4903-8721-aeb9dbdb6555 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1512 microversion: 2.1 time: 0.289871 Jan 28 02:04:34.641372 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 284/566] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:34 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1512 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:34.645958 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-09d96085-f341-4aa5-b6c3-4c8fdf51950f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:34.646639 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-09d96085-f341-4aa5-b6c3-4c8fdf51950f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:34.649547 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-68d7fe1f-00f6-47c5-a890-d58d901d9bf7 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.480131 Jan 28 02:04:34.650256 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 283/567] 10.222.0.77 () {58 vars in 1124 bytes} [Fri Jan 28 02:04:34 2022] GET /compute/v2.1/servers => generated 343 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:34.652667 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-09d96085-f341-4aa5-b6c3-4c8fdf51950f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:34.653113 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-09d96085-f341-4aa5-b6c3-4c8fdf51950f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:34.654450 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-09d96085-f341-4aa5-b6c3-4c8fdf51950f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:34.654865 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-09d96085-f341-4aa5-b6c3-4c8fdf51950f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:34.660820 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b4a5a9e1-0507-4d97-9626-3a5d36e52ef5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:34.661567 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b4a5a9e1-0507-4d97-9626-3a5d36e52ef5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:34.668627 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b4a5a9e1-0507-4d97-9626-3a5d36e52ef5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:34.669842 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b4a5a9e1-0507-4d97-9626-3a5d36e52ef5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:34.672459 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b4a5a9e1-0507-4d97-9626-3a5d36e52ef5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:34.673023 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b4a5a9e1-0507-4d97-9626-3a5d36e52ef5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:34.868838 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-09d96085-f341-4aa5-b6c3-4c8fdf51950f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:34.883486 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b4a5a9e1-0507-4d97-9626-3a5d36e52ef5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:34.884825 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-09d96085-f341-4aa5-b6c3-4c8fdf51950f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:34.887555 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-09d96085-f341-4aa5-b6c3-4c8fdf51950f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:34.889040 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-09d96085-f341-4aa5-b6c3-4c8fdf51950f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.246377 Jan 28 02:04:34.892061 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b4a5a9e1-0507-4d97-9626-3a5d36e52ef5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1550 microversion: 2.1 time: 0.234618 Jan 28 02:04:34.901973 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 284/568] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:34 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1550 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:34.902213 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 285/569] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:34 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:35.057287 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f1a9d806-a297-4dee-8629-940a230f9618 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:35.058022 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f1a9d806-a297-4dee-8629-940a230f9618 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:35.072096 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f1a9d806-a297-4dee-8629-940a230f9618 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:35.074735 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f1a9d806-a297-4dee-8629-940a230f9618 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:35.077509 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f1a9d806-a297-4dee-8629-940a230f9618 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:35.078001 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f1a9d806-a297-4dee-8629-940a230f9618 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:35.131776 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f1a9d806-a297-4dee-8629-940a230f9618 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080370 Jan 28 02:04:35.133019 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 285/570] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:04:35 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 02:04:35.648848 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9ce4d47e-6247-4972-8928-31364123d7f3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:35.650511 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9ce4d47e-6247-4972-8928-31364123d7f3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:35.659422 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9ce4d47e-6247-4972-8928-31364123d7f3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:35.659870 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9ce4d47e-6247-4972-8928-31364123d7f3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:35.660655 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9ce4d47e-6247-4972-8928-31364123d7f3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:35.661081 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9ce4d47e-6247-4972-8928-31364123d7f3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:35.850516 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9ce4d47e-6247-4972-8928-31364123d7f3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:35.859590 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9ce4d47e-6247-4972-8928-31364123d7f3 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1512 microversion: 2.1 time: 0.214991 Jan 28 02:04:35.860951 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 286/571] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:35 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:35.912691 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-89bc6248-f944-407f-8641-e992be5f4897 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:35.913386 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-89bc6248-f944-407f-8641-e992be5f4897 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:35.924303 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-89bc6248-f944-407f-8641-e992be5f4897 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:35.925787 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-89bc6248-f944-407f-8641-e992be5f4897 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:35.927737 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-89bc6248-f944-407f-8641-e992be5f4897 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:35.929479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-89bc6248-f944-407f-8641-e992be5f4897 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:36.170026 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-89bc6248-f944-407f-8641-e992be5f4897 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:36.193687 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-89bc6248-f944-407f-8641-e992be5f4897 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:36.195642 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-89bc6248-f944-407f-8641-e992be5f4897 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:36.197415 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-89bc6248-f944-407f-8641-e992be5f4897 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.288837 Jan 28 02:04:36.222228 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 286/572] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:35 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:36.280485 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-1c06858a-075d-42d9-91cc-8ded636628f3 req-a21afc93-b26c-4573-aca1-b462f177ee56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7e70ce-ff2e-4323-baec-1455763bb95f", "name": "network-vif-deleted", "tag": "bdfdebab-1bce-49af-b683-2bf00d7f807c"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:36.282352 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:36.282352 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:04:36.296454 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-1c06858a-075d-42d9-91cc-8ded636628f3 req-a21afc93-b26c-4573-aca1-b462f177ee56 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:36.296900 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-1c06858a-075d-42d9-91cc-8ded636628f3 req-a21afc93-b26c-4573-aca1-b462f177ee56 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:36.315377 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-1c06858a-075d-42d9-91cc-8ded636628f3 req-a21afc93-b26c-4573-aca1-b462f177ee56 service nova] Creating event network-vif-deleted:bdfdebab-1bce-49af-b683-2bf00d7f807c for instance 0c7e70ce-ff2e-4323-baec-1455763bb95f on hv-cinder-82497 Jan 28 02:04:36.322558 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-1c06858a-075d-42d9-91cc-8ded636628f3 req-a21afc93-b26c-4573-aca1-b462f177ee56 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046829 Jan 28 02:04:36.323365 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 287/573] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:36.880735 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-cc2601d3-2457-4abd-9db8-3d225275ea0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:36.881789 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-cc2601d3-2457-4abd-9db8-3d225275ea0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:36.895317 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cc2601d3-2457-4abd-9db8-3d225275ea0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:36.895770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cc2601d3-2457-4abd-9db8-3d225275ea0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:36.896574 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cc2601d3-2457-4abd-9db8-3d225275ea0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:36.897007 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cc2601d3-2457-4abd-9db8-3d225275ea0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:36.952637 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cc2601d3-2457-4abd-9db8-3d225275ea0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:36.953235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cc2601d3-2457-4abd-9db8-3d225275ea0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:36.953545 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-cc2601d3-2457-4abd-9db8-3d225275ea0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lazy-loading 'fault' on Instance uuid 0c7e70ce-ff2e-4323-baec-1455763bb95f {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:37.005695 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3eab0c2a-ccf3-4a14-9734-35debdba77f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63b4b152-990e-4ba4-9160-ef101ac8e724"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:37.006865 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3eab0c2a-ccf3-4a14-9734-35debdba77f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:37.036050 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3eab0c2a-ccf3-4a14-9734-35debdba77f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:37.038886 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3eab0c2a-ccf3-4a14-9734-35debdba77f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:37.045193 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3eab0c2a-ccf3-4a14-9734-35debdba77f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:37.046156 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3eab0c2a-ccf3-4a14-9734-35debdba77f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:37.074394 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-cc2601d3-2457-4abd-9db8-3d225275ea0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:37.093358 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-cc2601d3-2457-4abd-9db8-3d225275ea0c tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1308 microversion: 2.1 time: 0.219567 Jan 28 02:04:37.094346 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 287/574] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:36 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:37.223994 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c3541c4e-39ec-45c9-be98-94a408ee5fa6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:37.225619 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c3541c4e-39ec-45c9-be98-94a408ee5fa6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:37.234267 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c3541c4e-39ec-45c9-be98-94a408ee5fa6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:37.234707 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c3541c4e-39ec-45c9-be98-94a408ee5fa6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:37.238696 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c3541c4e-39ec-45c9-be98-94a408ee5fa6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:37.243263 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c3541c4e-39ec-45c9-be98-94a408ee5fa6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:37.441430 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c3541c4e-39ec-45c9-be98-94a408ee5fa6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:37.456816 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c3541c4e-39ec-45c9-be98-94a408ee5fa6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:37.458864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c3541c4e-39ec-45c9-be98-94a408ee5fa6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:37.460881 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c3541c4e-39ec-45c9-be98-94a408ee5fa6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.240195 Jan 28 02:04:37.460881 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 288/575] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:37 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:37.704924 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-db7a5467-b520-4207-b332-5204a7778f9e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:37.705838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-db7a5467-b520-4207-b332-5204a7778f9e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:37.715617 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-db7a5467-b520-4207-b332-5204a7778f9e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:37.716343 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-db7a5467-b520-4207-b332-5204a7778f9e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:37.717597 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-db7a5467-b520-4207-b332-5204a7778f9e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:37.718257 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-db7a5467-b520-4207-b332-5204a7778f9e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:37.756118 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-db7a5467-b520-4207-b332-5204a7778f9e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Going to try to terminate instance {{(pid=115761) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:04:37.858302 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-db7a5467-b520-4207-b332-5204a7778f9e tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 204 len: 0 microversion: 2.1 time: 0.158931 Jan 28 02:04:37.858857 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 289/576] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:04:37 2022] DELETE /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:04:37.873013 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5e4c2dad-580f-457b-82d4-5d7636fa63a6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:37.874184 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-5e4c2dad-580f-457b-82d4-5d7636fa63a6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:37.881673 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5e4c2dad-580f-457b-82d4-5d7636fa63a6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:37.882171 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5e4c2dad-580f-457b-82d4-5d7636fa63a6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:37.882991 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5e4c2dad-580f-457b-82d4-5d7636fa63a6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:37.883420 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5e4c2dad-580f-457b-82d4-5d7636fa63a6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:38.033971 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-5e4c2dad-580f-457b-82d4-5d7636fa63a6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:38.041886 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-5e4c2dad-580f-457b-82d4-5d7636fa63a6 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1508 microversion: 2.1 time: 0.176883 Jan 28 02:04:38.042518 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 290/577] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:37 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:38.123193 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e4aa7c43-454d-4119-b815-772298e39643 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:38.124255 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e4aa7c43-454d-4119-b815-772298e39643 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:38.130962 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4aa7c43-454d-4119-b815-772298e39643 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:38.131504 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4aa7c43-454d-4119-b815-772298e39643 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:38.132368 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4aa7c43-454d-4119-b815-772298e39643 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:38.132872 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4aa7c43-454d-4119-b815-772298e39643 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:38.184259 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4aa7c43-454d-4119-b815-772298e39643 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:38.184715 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4aa7c43-454d-4119-b815-772298e39643 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:38.186060 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-e4aa7c43-454d-4119-b815-772298e39643 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lazy-loading 'fault' on Instance uuid 0c7e70ce-ff2e-4323-baec-1455763bb95f {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:38.248231 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e4aa7c43-454d-4119-b815-772298e39643 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:38.256666 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e4aa7c43-454d-4119-b815-772298e39643 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1308 microversion: 2.1 time: 0.138103 Jan 28 02:04:38.257693 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 291/578] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:38 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1308 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:38.480280 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3721fb5e-0e58-4630-89ce-5e75fa854a31 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:38.480992 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3721fb5e-0e58-4630-89ce-5e75fa854a31 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:38.502027 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3721fb5e-0e58-4630-89ce-5e75fa854a31 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:38.502914 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3721fb5e-0e58-4630-89ce-5e75fa854a31 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:38.504269 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3721fb5e-0e58-4630-89ce-5e75fa854a31 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:38.504900 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3721fb5e-0e58-4630-89ce-5e75fa854a31 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:38.681080 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3721fb5e-0e58-4630-89ce-5e75fa854a31 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:38.691190 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3721fb5e-0e58-4630-89ce-5e75fa854a31 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:38.693210 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3721fb5e-0e58-4630-89ce-5e75fa854a31 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:38.694905 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3721fb5e-0e58-4630-89ce-5e75fa854a31 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.219090 Jan 28 02:04:38.696023 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 292/579] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:38 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:39.068770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b384ebac-b14d-44a7-8b97-944847184105 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:39.070621 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b384ebac-b14d-44a7-8b97-944847184105 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:39.083584 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b384ebac-b14d-44a7-8b97-944847184105 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:39.084339 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b384ebac-b14d-44a7-8b97-944847184105 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:39.085324 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b384ebac-b14d-44a7-8b97-944847184105 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:39.085998 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b384ebac-b14d-44a7-8b97-944847184105 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:39.328148 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b384ebac-b14d-44a7-8b97-944847184105 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:39.338342 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b384ebac-b14d-44a7-8b97-944847184105 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1508 microversion: 2.1 time: 0.273938 Jan 28 02:04:39.338989 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 293/580] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:39 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:39.355238 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-fd869ee9-53a8-455d-9875-045150d3a030 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:39.356246 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-fd869ee9-53a8-455d-9875-045150d3a030 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:39.368615 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fd869ee9-53a8-455d-9875-045150d3a030 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:39.369345 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fd869ee9-53a8-455d-9875-045150d3a030 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:39.370757 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fd869ee9-53a8-455d-9875-045150d3a030 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:39.371427 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fd869ee9-53a8-455d-9875-045150d3a030 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:39.444258 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fd869ee9-53a8-455d-9875-045150d3a030 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:39.444710 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fd869ee9-53a8-455d-9875-045150d3a030 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:39.445173 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-fd869ee9-53a8-455d-9875-045150d3a030 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lazy-loading 'fault' on Instance uuid 0c7e70ce-ff2e-4323-baec-1455763bb95f {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:39.503319 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-fd869ee9-53a8-455d-9875-045150d3a030 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:39.512010 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-fd869ee9-53a8-455d-9875-045150d3a030 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1308 microversion: 2.1 time: 0.171784 Jan 28 02:04:39.512747 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 294/581] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:39 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1308 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:39.714459 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-12aa5595-e782-4ae4-a317-969dfca960b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:39.715076 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-12aa5595-e782-4ae4-a317-969dfca960b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:39.721340 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-12aa5595-e782-4ae4-a317-969dfca960b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:39.721829 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-12aa5595-e782-4ae4-a317-969dfca960b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:39.722640 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-12aa5595-e782-4ae4-a317-969dfca960b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:39.723074 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-12aa5595-e782-4ae4-a317-969dfca960b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:39.870322 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-12aa5595-e782-4ae4-a317-969dfca960b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:39.881817 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-12aa5595-e782-4ae4-a317-969dfca960b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:39.883300 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-12aa5595-e782-4ae4-a317-969dfca960b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:39.884590 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-12aa5595-e782-4ae4-a317-969dfca960b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.174000 Jan 28 02:04:39.885354 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 295/582] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:39 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:40.355095 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8dba6f41-6a0f-43d9-acc7-471cbe5517ba tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:40.355796 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8dba6f41-6a0f-43d9-acc7-471cbe5517ba tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:40.362145 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8dba6f41-6a0f-43d9-acc7-471cbe5517ba tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:40.362672 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8dba6f41-6a0f-43d9-acc7-471cbe5517ba tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:40.363679 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8dba6f41-6a0f-43d9-acc7-471cbe5517ba tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:40.364170 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8dba6f41-6a0f-43d9-acc7-471cbe5517ba tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:40.521626 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8dba6f41-6a0f-43d9-acc7-471cbe5517ba tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:40.534323 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8dba6f41-6a0f-43d9-acc7-471cbe5517ba tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1508 microversion: 2.1 time: 0.181599 Jan 28 02:04:40.536504 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 296/583] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:40 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:40.546167 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7467af19-f6dd-4f31-9fed-eb1fbcb4ebc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:40.546893 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7467af19-f6dd-4f31-9fed-eb1fbcb4ebc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:40.567847 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7467af19-f6dd-4f31-9fed-eb1fbcb4ebc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:40.568561 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7467af19-f6dd-4f31-9fed-eb1fbcb4ebc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:40.569674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7467af19-f6dd-4f31-9fed-eb1fbcb4ebc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:40.570282 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7467af19-f6dd-4f31-9fed-eb1fbcb4ebc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:40.626229 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7467af19-f6dd-4f31-9fed-eb1fbcb4ebc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:40.635000 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7467af19-f6dd-4f31-9fed-eb1fbcb4ebc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:40.635844 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-7467af19-f6dd-4f31-9fed-eb1fbcb4ebc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lazy-loading 'fault' on Instance uuid 0c7e70ce-ff2e-4323-baec-1455763bb95f {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:40.718165 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7467af19-f6dd-4f31-9fed-eb1fbcb4ebc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:40.726058 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7467af19-f6dd-4f31-9fed-eb1fbcb4ebc8 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1308 microversion: 2.1 time: 0.188143 Jan 28 02:04:40.726653 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 297/584] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:40 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:40.905940 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-269ecab8-3c3a-430e-b402-2c374a14e2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:40.906859 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-269ecab8-3c3a-430e-b402-2c374a14e2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:40.919466 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-269ecab8-3c3a-430e-b402-2c374a14e2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:40.920512 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-269ecab8-3c3a-430e-b402-2c374a14e2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:40.924299 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-269ecab8-3c3a-430e-b402-2c374a14e2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:40.924779 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-269ecab8-3c3a-430e-b402-2c374a14e2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:41.134686 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-269ecab8-3c3a-430e-b402-2c374a14e2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:41.144125 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-269ecab8-3c3a-430e-b402-2c374a14e2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:41.145646 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-269ecab8-3c3a-430e-b402-2c374a14e2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:41.146850 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-269ecab8-3c3a-430e-b402-2c374a14e2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.246012 Jan 28 02:04:41.158732 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 298/585] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:40 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:41.552433 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1b4f2f0a-428a-4b70-a4fe-2b0c1457dd62 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:41.554032 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1b4f2f0a-428a-4b70-a4fe-2b0c1457dd62 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:41.568824 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b4f2f0a-428a-4b70-a4fe-2b0c1457dd62 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:41.568824 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b4f2f0a-428a-4b70-a4fe-2b0c1457dd62 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:41.568824 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b4f2f0a-428a-4b70-a4fe-2b0c1457dd62 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:41.568824 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1b4f2f0a-428a-4b70-a4fe-2b0c1457dd62 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:41.722567 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1b4f2f0a-428a-4b70-a4fe-2b0c1457dd62 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:41.733764 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1b4f2f0a-428a-4b70-a4fe-2b0c1457dd62 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1508 microversion: 2.1 time: 0.184237 Jan 28 02:04:41.734640 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 299/586] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:41 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:41.746540 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-fc43727a-0eae-48d3-bfc6-82a84f22da07 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:41.747310 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-fc43727a-0eae-48d3-bfc6-82a84f22da07 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:41.754709 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fc43727a-0eae-48d3-bfc6-82a84f22da07 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:41.755621 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fc43727a-0eae-48d3-bfc6-82a84f22da07 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:41.756797 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fc43727a-0eae-48d3-bfc6-82a84f22da07 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:41.757600 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fc43727a-0eae-48d3-bfc6-82a84f22da07 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:41.792289 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fc43727a-0eae-48d3-bfc6-82a84f22da07 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:41.793116 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fc43727a-0eae-48d3-bfc6-82a84f22da07 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:41.793873 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-fc43727a-0eae-48d3-bfc6-82a84f22da07 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lazy-loading 'fault' on Instance uuid 0c7e70ce-ff2e-4323-baec-1455763bb95f {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:41.847691 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-fc43727a-0eae-48d3-bfc6-82a84f22da07 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:41.856572 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-fc43727a-0eae-48d3-bfc6-82a84f22da07 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1308 microversion: 2.1 time: 0.113773 Jan 28 02:04:41.858556 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 300/587] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:41 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:42.165843 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e3cff4ca-9e36-40ec-87d3-acb0239e09ff tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:42.166381 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e3cff4ca-9e36-40ec-87d3-acb0239e09ff tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:42.173489 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e3cff4ca-9e36-40ec-87d3-acb0239e09ff tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.173909 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e3cff4ca-9e36-40ec-87d3-acb0239e09ff tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.174739 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e3cff4ca-9e36-40ec-87d3-acb0239e09ff tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.175172 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e3cff4ca-9e36-40ec-87d3-acb0239e09ff tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.332685 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e3cff4ca-9e36-40ec-87d3-acb0239e09ff tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:42.345784 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e3cff4ca-9e36-40ec-87d3-acb0239e09ff tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:42.347296 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e3cff4ca-9e36-40ec-87d3-acb0239e09ff tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:42.348482 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e3cff4ca-9e36-40ec-87d3-acb0239e09ff tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.186455 Jan 28 02:04:42.349377 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 301/588] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:42 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:42.757321 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f7f5ba34-4b87-4f07-a735-a8e8d37f3538 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:42.758190 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f7f5ba34-4b87-4f07-a735-a8e8d37f3538 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:42.764685 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba34-4b87-4f07-a735-a8e8d37f3538 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.765133 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba34-4b87-4f07-a735-a8e8d37f3538 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.765975 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba34-4b87-4f07-a735-a8e8d37f3538 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.766408 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba34-4b87-4f07-a735-a8e8d37f3538 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.905874 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f7f5ba34-4b87-4f07-a735-a8e8d37f3538 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:42.912966 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f7f5ba34-4b87-4f07-a735-a8e8d37f3538 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1508 microversion: 2.1 time: 0.159248 Jan 28 02:04:42.913940 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 302/589] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:42 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:42.918316 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-06d11001-5691-41ac-8649-9ce3e64e0066 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:42.918918 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-06d11001-5691-41ac-8649-9ce3e64e0066 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:42.925180 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-06d11001-5691-41ac-8649-9ce3e64e0066 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.925653 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-06d11001-5691-41ac-8649-9ce3e64e0066 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.926527 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-06d11001-5691-41ac-8649-9ce3e64e0066 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.926851 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-06d11001-5691-41ac-8649-9ce3e64e0066 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.959616 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-06d11001-5691-41ac-8649-9ce3e64e0066 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.960296 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-06d11001-5691-41ac-8649-9ce3e64e0066 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.960897 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-06d11001-5691-41ac-8649-9ce3e64e0066 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lazy-loading 'fault' on Instance uuid 0c7e70ce-ff2e-4323-baec-1455763bb95f {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:43.005006 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-06d11001-5691-41ac-8649-9ce3e64e0066 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:43.012361 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-06d11001-5691-41ac-8649-9ce3e64e0066 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1308 microversion: 2.1 time: 0.097336 Jan 28 02:04:43.012860 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 303/590] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:42 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:43.368158 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8d1f784f-5808-4a9f-ab51-eb96513c3aaa tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:43.368860 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8d1f784f-5808-4a9f-ab51-eb96513c3aaa tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:43.376104 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d1f784f-5808-4a9f-ab51-eb96513c3aaa tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:43.376552 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d1f784f-5808-4a9f-ab51-eb96513c3aaa tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:43.377335 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d1f784f-5808-4a9f-ab51-eb96513c3aaa tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:43.377798 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d1f784f-5808-4a9f-ab51-eb96513c3aaa tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:43.532007 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8d1f784f-5808-4a9f-ab51-eb96513c3aaa tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:43.540645 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8d1f784f-5808-4a9f-ab51-eb96513c3aaa tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:43.542351 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8d1f784f-5808-4a9f-ab51-eb96513c3aaa tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:43.543541 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8d1f784f-5808-4a9f-ab51-eb96513c3aaa tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.179109 Jan 28 02:04:43.552355 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 304/591] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:43 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:43.930864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d2247472-10ad-43eb-97e7-fd6191ae43a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:43.931605 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d2247472-10ad-43eb-97e7-fd6191ae43a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:43.938322 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d2247472-10ad-43eb-97e7-fd6191ae43a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:43.938766 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d2247472-10ad-43eb-97e7-fd6191ae43a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:43.939813 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d2247472-10ad-43eb-97e7-fd6191ae43a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:43.940245 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d2247472-10ad-43eb-97e7-fd6191ae43a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:44.070729 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d2247472-10ad-43eb-97e7-fd6191ae43a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:44.077988 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d2247472-10ad-43eb-97e7-fd6191ae43a9 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1508 microversion: 2.1 time: 0.150772 Jan 28 02:04:44.078547 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 305/592] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:43 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:44.082747 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-713b3aa7-cde3-4eb7-8ec0-c8209bcf4510 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:44.083340 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-713b3aa7-cde3-4eb7-8ec0-c8209bcf4510 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:44.088692 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-713b3aa7-cde3-4eb7-8ec0-c8209bcf4510 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:44.089131 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-713b3aa7-cde3-4eb7-8ec0-c8209bcf4510 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:44.089912 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-713b3aa7-cde3-4eb7-8ec0-c8209bcf4510 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:44.090338 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-713b3aa7-cde3-4eb7-8ec0-c8209bcf4510 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:44.127352 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-713b3aa7-cde3-4eb7-8ec0-c8209bcf4510 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:44.127797 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-713b3aa7-cde3-4eb7-8ec0-c8209bcf4510 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:44.128253 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-713b3aa7-cde3-4eb7-8ec0-c8209bcf4510 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lazy-loading 'fault' on Instance uuid 0c7e70ce-ff2e-4323-baec-1455763bb95f {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:44.171667 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-713b3aa7-cde3-4eb7-8ec0-c8209bcf4510 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717e2ab2be74631aba4b196112bf984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:44.184951 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-713b3aa7-cde3-4eb7-8ec0-c8209bcf4510 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 200 len: 1308 microversion: 2.1 time: 0.104974 Jan 28 02:04:44.185924 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 306/593] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:44 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:44.563043 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ed396bb9-5dd4-47f8-8a3f-eba8d3d8a2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:44.563954 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ed396bb9-5dd4-47f8-8a3f-eba8d3d8a2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:44.572034 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ed396bb9-5dd4-47f8-8a3f-eba8d3d8a2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:44.572585 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ed396bb9-5dd4-47f8-8a3f-eba8d3d8a2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:44.574184 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ed396bb9-5dd4-47f8-8a3f-eba8d3d8a2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:44.574621 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ed396bb9-5dd4-47f8-8a3f-eba8d3d8a2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:44.581407 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3eab0c2a-ccf3-4a14-9734-35debdba77f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "POST /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.580373 Jan 28 02:04:44.589403 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 288/594] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:04:36 2022] POST /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/os-volume_attachments => generated 194 bytes in 7583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:04:44.732850 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ed396bb9-5dd4-47f8-8a3f-eba8d3d8a2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:44.743133 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ed396bb9-5dd4-47f8-8a3f-eba8d3d8a2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:44.744608 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ed396bb9-5dd4-47f8-8a3f-eba8d3d8a2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:44.745798 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ed396bb9-5dd4-47f8-8a3f-eba8d3d8a2b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.186908 Jan 28 02:04:44.746354 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 307/595] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:44 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:45.095425 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-85a9525e-2d46-40a3-8da1-e46f3d9ecf8f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:45.096029 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-85a9525e-2d46-40a3-8da1-e46f3d9ecf8f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:45.102241 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-85a9525e-2d46-40a3-8da1-e46f3d9ecf8f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:45.102689 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-85a9525e-2d46-40a3-8da1-e46f3d9ecf8f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:45.103459 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-85a9525e-2d46-40a3-8da1-e46f3d9ecf8f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:45.103891 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-85a9525e-2d46-40a3-8da1-e46f3d9ecf8f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:45.206092 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0d1be337-0b15-43c0-bbb8-47db14319379 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:45.206751 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0d1be337-0b15-43c0-bbb8-47db14319379 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] [instance: 0c7e70ce-ff2e-4323-baec-1455763bb95f] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:45.213556 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0d1be337-0b15-43c0-bbb8-47db14319379 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:45.214066 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0d1be337-0b15-43c0-bbb8-47db14319379 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:45.214886 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0d1be337-0b15-43c0-bbb8-47db14319379 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:45.215378 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0d1be337-0b15-43c0-bbb8-47db14319379 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:45.235316 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-0d1be337-0b15-43c0-bbb8-47db14319379 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] HTTP exception thrown: Instance 0c7e70ce-ff2e-4323-baec-1455763bb95f could not be found. Jan 28 02:04:45.235953 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0d1be337-0b15-43c0-bbb8-47db14319379 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] Returning 404 to user: Instance 0c7e70ce-ff2e-4323-baec-1455763bb95f could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:45.236893 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0d1be337-0b15-43c0-bbb8-47db14319379 tempest-AttachVolumeNegativeTest-579488824 tempest-AttachVolumeNegativeTest-579488824-project] 10.222.0.77 "GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f" status: 404 len: 111 microversion: 2.1 time: 0.035114 Jan 28 02:04:45.237535 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 308/596] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:45 2022] GET /compute/v2.1/servers/0c7e70ce-ff2e-4323-baec-1455763bb95f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:04:45.248952 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-85a9525e-2d46-40a3-8da1-e46f3d9ecf8f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:45.257120 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-85a9525e-2d46-40a3-8da1-e46f3d9ecf8f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1508 microversion: 2.1 time: 0.165874 Jan 28 02:04:45.258154 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 289/597] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:45 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:45.765344 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-281c7c47-cc0a-4c32-9c56-a793e4225371 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:45.766135 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-281c7c47-cc0a-4c32-9c56-a793e4225371 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:45.772325 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-281c7c47-cc0a-4c32-9c56-a793e4225371 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:45.772860 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-281c7c47-cc0a-4c32-9c56-a793e4225371 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:45.773627 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-281c7c47-cc0a-4c32-9c56-a793e4225371 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:45.774250 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-281c7c47-cc0a-4c32-9c56-a793e4225371 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:45.895264 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-281c7c47-cc0a-4c32-9c56-a793e4225371 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:45.904013 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-281c7c47-cc0a-4c32-9c56-a793e4225371 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:45.905539 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-281c7c47-cc0a-4c32-9c56-a793e4225371 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:45.906728 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-281c7c47-cc0a-4c32-9c56-a793e4225371 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.145751 Jan 28 02:04:45.907268 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 309/598] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:45 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:46.278972 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-dfb44704-65fe-4eed-825a-fb0d4e0d6fde tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:46.280066 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-dfb44704-65fe-4eed-825a-fb0d4e0d6fde tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:46.286922 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dfb44704-65fe-4eed-825a-fb0d4e0d6fde tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:46.287108 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dfb44704-65fe-4eed-825a-fb0d4e0d6fde tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:46.287882 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dfb44704-65fe-4eed-825a-fb0d4e0d6fde tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:46.288312 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-dfb44704-65fe-4eed-825a-fb0d4e0d6fde tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:46.444630 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-dfb44704-65fe-4eed-825a-fb0d4e0d6fde tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:46.452520 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-dfb44704-65fe-4eed-825a-fb0d4e0d6fde tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1508 microversion: 2.1 time: 0.177951 Jan 28 02:04:46.453080 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 290/599] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:46 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:46.925516 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-62901b44-114b-4eaa-a209-dcaa7300d250 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:46.925516 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-62901b44-114b-4eaa-a209-dcaa7300d250 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:46.931020 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-62901b44-114b-4eaa-a209-dcaa7300d250 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:46.931457 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-62901b44-114b-4eaa-a209-dcaa7300d250 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:46.932241 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-62901b44-114b-4eaa-a209-dcaa7300d250 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:46.932661 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-62901b44-114b-4eaa-a209-dcaa7300d250 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:47.063417 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-62901b44-114b-4eaa-a209-dcaa7300d250 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:47.072268 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-62901b44-114b-4eaa-a209-dcaa7300d250 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:47.074305 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-62901b44-114b-4eaa-a209-dcaa7300d250 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:47.075458 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-62901b44-114b-4eaa-a209-dcaa7300d250 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.154462 Jan 28 02:04:47.076273 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 310/600] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:46 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:47.468501 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5a1b4780-6c36-4076-ba9e-fe491e46a0c8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:47.469102 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5a1b4780-6c36-4076-ba9e-fe491e46a0c8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:47.475163 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5a1b4780-6c36-4076-ba9e-fe491e46a0c8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:47.475609 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5a1b4780-6c36-4076-ba9e-fe491e46a0c8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:47.476385 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5a1b4780-6c36-4076-ba9e-fe491e46a0c8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:47.476816 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5a1b4780-6c36-4076-ba9e-fe491e46a0c8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:47.609549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5a1b4780-6c36-4076-ba9e-fe491e46a0c8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:47.618404 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5a1b4780-6c36-4076-ba9e-fe491e46a0c8 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 200 len: 1508 microversion: 2.1 time: 0.153590 Jan 28 02:04:47.619545 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 291/601] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:47 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:47.809479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-3fe0dec9-14a7-48de-9b1e-5a539cabe3b7 req-ca98ec64-5c16-4879-9377-d6b197707f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d62c44-4ca6-4d5a-bd60-2f5e9e821199", "name": "network-vif-deleted", "tag": "74b68811-cff5-4440-b73c-e6a15a359cac"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:47.811284 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:47.811284 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:04:47.825010 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-3fe0dec9-14a7-48de-9b1e-5a539cabe3b7 req-ca98ec64-5c16-4879-9377-d6b197707f88 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:47.825549 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-3fe0dec9-14a7-48de-9b1e-5a539cabe3b7 req-ca98ec64-5c16-4879-9377-d6b197707f88 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:47.841176 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-3fe0dec9-14a7-48de-9b1e-5a539cabe3b7 req-ca98ec64-5c16-4879-9377-d6b197707f88 service nova] Creating event network-vif-deleted:74b68811-cff5-4440-b73c-e6a15a359cac for instance c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 on hv-cinder-82497 Jan 28 02:04:47.849173 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-3fe0dec9-14a7-48de-9b1e-5a539cabe3b7 req-ca98ec64-5c16-4879-9377-d6b197707f88 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047006 Jan 28 02:04:47.850440 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 311/602] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:48.096413 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-add617cc-1684-4240-85aa-7cd4ecb17c00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:48.097351 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-add617cc-1684-4240-85aa-7cd4ecb17c00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:48.104173 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-add617cc-1684-4240-85aa-7cd4ecb17c00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:48.104727 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-add617cc-1684-4240-85aa-7cd4ecb17c00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:48.105835 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-add617cc-1684-4240-85aa-7cd4ecb17c00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:48.106343 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-add617cc-1684-4240-85aa-7cd4ecb17c00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:48.283307 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-add617cc-1684-4240-85aa-7cd4ecb17c00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:48.292526 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-add617cc-1684-4240-85aa-7cd4ecb17c00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:48.294277 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-add617cc-1684-4240-85aa-7cd4ecb17c00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:48.295459 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-add617cc-1684-4240-85aa-7cd4ecb17c00 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.204534 Jan 28 02:04:48.296002 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 292/603] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:48 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:48.639578 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1a95a418-d6c3-4b34-a62a-733ec4d44c1a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:48.640260 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1a95a418-d6c3-4b34-a62a-733ec4d44c1a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: c8d62c44-4ca6-4d5a-bd60-2f5e9e821199] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:48.646511 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1a95a418-d6c3-4b34-a62a-733ec4d44c1a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:48.646953 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1a95a418-d6c3-4b34-a62a-733ec4d44c1a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:48.647742 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1a95a418-d6c3-4b34-a62a-733ec4d44c1a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:48.648140 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1a95a418-d6c3-4b34-a62a-733ec4d44c1a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:48.661797 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-1a95a418-d6c3-4b34-a62a-733ec4d44c1a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] HTTP exception thrown: Instance c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 could not be found. Jan 28 02:04:48.662425 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1a95a418-d6c3-4b34-a62a-733ec4d44c1a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Returning 404 to user: Instance c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:48.663242 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1a95a418-d6c3-4b34-a62a-733ec4d44c1a tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199" status: 404 len: 111 microversion: 2.1 time: 0.028910 Jan 28 02:04:48.663930 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 312/604] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:48 2022] GET /compute/v2.1/servers/c8d62c44-4ca6-4d5a-bd60-2f5e9e821199 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:04:48.671855 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-73be8b11-a5c7-478a-88db-2e660ef04706 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:48.672459 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-73be8b11-a5c7-478a-88db-2e660ef04706 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:48.678227 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-73be8b11-a5c7-478a-88db-2e660ef04706 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:48.678611 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-73be8b11-a5c7-478a-88db-2e660ef04706 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:48.679482 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-73be8b11-a5c7-478a-88db-2e660ef04706 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:48.679911 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-73be8b11-a5c7-478a-88db-2e660ef04706 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:48.708318 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-73be8b11-a5c7-478a-88db-2e660ef04706 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:04:48.794561 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-73be8b11-a5c7-478a-88db-2e660ef04706 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "DELETE /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 204 len: 0 microversion: 2.1 time: 0.125926 Jan 28 02:04:48.795667 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 293/605] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:04:48 2022] DELETE /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:04:48.803866 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-70f6858e-47af-4934-b8b5-0da6c58bf984 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:48.804465 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-70f6858e-47af-4934-b8b5-0da6c58bf984 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:48.811412 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-70f6858e-47af-4934-b8b5-0da6c58bf984 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:48.811964 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-70f6858e-47af-4934-b8b5-0da6c58bf984 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:48.812729 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-70f6858e-47af-4934-b8b5-0da6c58bf984 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:48.813156 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-70f6858e-47af-4934-b8b5-0da6c58bf984 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:48.978227 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-70f6858e-47af-4934-b8b5-0da6c58bf984 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:48.989016 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-70f6858e-47af-4934-b8b5-0da6c58bf984 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.189111 Jan 28 02:04:48.989661 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 313/606] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:48 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:49.313803 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-82e46118-3acc-41c6-9d5c-35cbdfa7be19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:49.314374 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-82e46118-3acc-41c6-9d5c-35cbdfa7be19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:49.321316 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-82e46118-3acc-41c6-9d5c-35cbdfa7be19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:49.321783 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-82e46118-3acc-41c6-9d5c-35cbdfa7be19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:49.322715 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-82e46118-3acc-41c6-9d5c-35cbdfa7be19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:49.323144 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-82e46118-3acc-41c6-9d5c-35cbdfa7be19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:49.454029 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-82e46118-3acc-41c6-9d5c-35cbdfa7be19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:49.465554 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-82e46118-3acc-41c6-9d5c-35cbdfa7be19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:49.467159 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-82e46118-3acc-41c6-9d5c-35cbdfa7be19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:49.468401 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-82e46118-3acc-41c6-9d5c-35cbdfa7be19 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.159610 Jan 28 02:04:49.468856 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 294/607] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:49 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:50.005895 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b01f769b-b0a6-4ec7-a1bc-115c87ce1f49 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:50.006505 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b01f769b-b0a6-4ec7-a1bc-115c87ce1f49 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:50.013226 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b01f769b-b0a6-4ec7-a1bc-115c87ce1f49 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:50.013226 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b01f769b-b0a6-4ec7-a1bc-115c87ce1f49 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:50.013924 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b01f769b-b0a6-4ec7-a1bc-115c87ce1f49 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:50.014342 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b01f769b-b0a6-4ec7-a1bc-115c87ce1f49 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:50.143499 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b01f769b-b0a6-4ec7-a1bc-115c87ce1f49 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:50.150668 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b01f769b-b0a6-4ec7-a1bc-115c87ce1f49 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.148379 Jan 28 02:04:50.151228 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 314/608] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:50 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:50.485683 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-525bac6f-c1c4-4788-9965-49e70204aef6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:50.487106 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-525bac6f-c1c4-4788-9965-49e70204aef6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:50.493415 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-525bac6f-c1c4-4788-9965-49e70204aef6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:50.493906 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-525bac6f-c1c4-4788-9965-49e70204aef6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:50.495150 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-525bac6f-c1c4-4788-9965-49e70204aef6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:50.495597 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-525bac6f-c1c4-4788-9965-49e70204aef6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:50.622977 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-525bac6f-c1c4-4788-9965-49e70204aef6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:50.631987 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-525bac6f-c1c4-4788-9965-49e70204aef6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:50.633475 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-525bac6f-c1c4-4788-9965-49e70204aef6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:50.634670 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-525bac6f-c1c4-4788-9965-49e70204aef6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.152801 Jan 28 02:04:50.635278 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 295/609] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:50 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:51.166552 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2f8dbd10-6361-4e13-b289-c14864d51e29 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:51.167151 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-2f8dbd10-6361-4e13-b289-c14864d51e29 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:51.173520 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2f8dbd10-6361-4e13-b289-c14864d51e29 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:51.173990 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2f8dbd10-6361-4e13-b289-c14864d51e29 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:51.174748 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2f8dbd10-6361-4e13-b289-c14864d51e29 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:51.175178 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2f8dbd10-6361-4e13-b289-c14864d51e29 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:51.298900 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-2f8dbd10-6361-4e13-b289-c14864d51e29 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:51.306271 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2f8dbd10-6361-4e13-b289-c14864d51e29 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.143313 Jan 28 02:04:51.306921 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 315/610] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:51 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:51.659710 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-0164007f-ce97-42db-a356-eaaf50ed6fc4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:51.660454 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-0164007f-ce97-42db-a356-eaaf50ed6fc4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:51.666931 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0164007f-ce97-42db-a356-eaaf50ed6fc4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:51.667506 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0164007f-ce97-42db-a356-eaaf50ed6fc4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:51.668374 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0164007f-ce97-42db-a356-eaaf50ed6fc4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:51.668809 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0164007f-ce97-42db-a356-eaaf50ed6fc4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:51.742699 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:04:51.743037 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: Fri Jan 28 02:04:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 (ip 10.222.0.77) !!! Jan 28 02:04:51.804394 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-0164007f-ce97-42db-a356-eaaf50ed6fc4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:51.815507 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-0164007f-ce97-42db-a356-eaaf50ed6fc4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:51.817083 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-0164007f-ce97-42db-a356-eaaf50ed6fc4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:51.818361 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-0164007f-ce97-42db-a356-eaaf50ed6fc4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.162854 Jan 28 02:04:51.818985 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 296/611] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:51 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:52.281903 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-15c6714d-d70a-49ec-9967-a57d51c5323d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:52.282570 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-15c6714d-d70a-49ec-9967-a57d51c5323d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:52.289080 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-15c6714d-d70a-49ec-9967-a57d51c5323d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:52.289526 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-15c6714d-d70a-49ec-9967-a57d51c5323d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:52.290393 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-15c6714d-d70a-49ec-9967-a57d51c5323d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:52.290907 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-15c6714d-d70a-49ec-9967-a57d51c5323d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:52.327090 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2edcd32e-dab8-4893-8810-039f20cc3c77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:52.328091 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2edcd32e-dab8-4893-8810-039f20cc3c77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:52.338150 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2edcd32e-dab8-4893-8810-039f20cc3c77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:52.338877 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2edcd32e-dab8-4893-8810-039f20cc3c77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:52.340391 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2edcd32e-dab8-4893-8810-039f20cc3c77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:52.341118 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2edcd32e-dab8-4893-8810-039f20cc3c77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:52.515968 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-15c6714d-d70a-49ec-9967-a57d51c5323d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:52.529718 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-15c6714d-d70a-49ec-9967-a57d51c5323d tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1596 microversion: 2.1 time: 0.251619 Jan 28 02:04:52.530693 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 316/612] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:52 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1596 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:52.633771 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-2edcd32e-dab8-4893-8810-039f20cc3c77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:52.646131 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2edcd32e-dab8-4893-8810-039f20cc3c77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.324906 Jan 28 02:04:52.647108 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 297/613] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:52 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:52.837463 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-691b4705-3845-4f7b-b7da-78ac9cbd0467 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:52.837463 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-691b4705-3845-4f7b-b7da-78ac9cbd0467 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:52.843970 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-691b4705-3845-4f7b-b7da-78ac9cbd0467 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:52.844490 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-691b4705-3845-4f7b-b7da-78ac9cbd0467 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:52.845479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-691b4705-3845-4f7b-b7da-78ac9cbd0467 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:52.846022 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-691b4705-3845-4f7b-b7da-78ac9cbd0467 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:53.008978 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-691b4705-3845-4f7b-b7da-78ac9cbd0467 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:53.024719 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-691b4705-3845-4f7b-b7da-78ac9cbd0467 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:53.027001 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-691b4705-3845-4f7b-b7da-78ac9cbd0467 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:53.028383 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-691b4705-3845-4f7b-b7da-78ac9cbd0467 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.195420 Jan 28 02:04:53.029087 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 317/614] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:52 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:53.670564 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-89f02fde-0aed-47c8-8f29-6cd57fa3ef77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:53.671166 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-89f02fde-0aed-47c8-8f29-6cd57fa3ef77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:53.677365 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-89f02fde-0aed-47c8-8f29-6cd57fa3ef77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:53.677826 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-89f02fde-0aed-47c8-8f29-6cd57fa3ef77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:53.678620 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-89f02fde-0aed-47c8-8f29-6cd57fa3ef77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:53.679072 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-89f02fde-0aed-47c8-8f29-6cd57fa3ef77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:53.950624 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-89f02fde-0aed-47c8-8f29-6cd57fa3ef77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:53.962080 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-89f02fde-0aed-47c8-8f29-6cd57fa3ef77 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.295355 Jan 28 02:04:53.964359 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 298/615] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:53 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:54.056458 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e5d989c5-cdce-4e26-b3fc-ebe46bb409ac tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:54.057307 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e5d989c5-cdce-4e26-b3fc-ebe46bb409ac tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:54.064418 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e5d989c5-cdce-4e26-b3fc-ebe46bb409ac tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:54.065318 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e5d989c5-cdce-4e26-b3fc-ebe46bb409ac tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:54.066332 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e5d989c5-cdce-4e26-b3fc-ebe46bb409ac tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:54.066990 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e5d989c5-cdce-4e26-b3fc-ebe46bb409ac tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:54.393624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e5d989c5-cdce-4e26-b3fc-ebe46bb409ac tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:54.403380 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e5d989c5-cdce-4e26-b3fc-ebe46bb409ac tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:54.408146 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e5d989c5-cdce-4e26-b3fc-ebe46bb409ac tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:54.408146 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e5d989c5-cdce-4e26-b3fc-ebe46bb409ac tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.355330 Jan 28 02:04:54.408146 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 318/616] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:54 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:54.983258 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3ab74ae3-f341-4c9d-8196-65c9592d7c9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:54.985104 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3ab74ae3-f341-4c9d-8196-65c9592d7c9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:54.993209 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3ab74ae3-f341-4c9d-8196-65c9592d7c9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:54.993885 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3ab74ae3-f341-4c9d-8196-65c9592d7c9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:54.994890 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3ab74ae3-f341-4c9d-8196-65c9592d7c9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:54.995491 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3ab74ae3-f341-4c9d-8196-65c9592d7c9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:55.074997 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-402545e2-6f50-44c1-9d1d-81aad661c2e5 req-1bc615d8-04a8-4d08-98f9-d19ba4a5a76e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99e0d03-1fe8-4dd7-9c5d-e67a633ab920", "tag": "df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:55.076661 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:55.076661 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:04:55.096438 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-402545e2-6f50-44c1-9d1d-81aad661c2e5 req-1bc615d8-04a8-4d08-98f9-d19ba4a5a76e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:55.096438 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-402545e2-6f50-44c1-9d1d-81aad661c2e5 req-1bc615d8-04a8-4d08-98f9-d19ba4a5a76e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:55.121339 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-402545e2-6f50-44c1-9d1d-81aad661c2e5 req-1bc615d8-04a8-4d08-98f9-d19ba4a5a76e service nova] Creating event network-changed:df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1 for instance b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 on hv-cinder-82497 Jan 28 02:04:55.130033 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-402545e2-6f50-44c1-9d1d-81aad661c2e5 req-1bc615d8-04a8-4d08-98f9-d19ba4a5a76e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059654 Jan 28 02:04:55.138065 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 319/617] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:55.236983 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-3ab74ae3-f341-4c9d-8196-65c9592d7c9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:55.247559 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3ab74ae3-f341-4c9d-8196-65c9592d7c9f tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1521 microversion: 2.1 time: 0.269916 Jan 28 02:04:55.258154 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 299/618] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:54 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:55.428282 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ee68ef33-de56-4e54-bc92-a01d017d7f43 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:55.429359 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ee68ef33-de56-4e54-bc92-a01d017d7f43 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:55.444317 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ee68ef33-de56-4e54-bc92-a01d017d7f43 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:55.445239 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ee68ef33-de56-4e54-bc92-a01d017d7f43 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:55.446282 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ee68ef33-de56-4e54-bc92-a01d017d7f43 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:55.446734 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ee68ef33-de56-4e54-bc92-a01d017d7f43 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:55.626708 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-8e0f80a3-98fe-47e6-b4e4-f8f24598c166 req-ccee508d-3b68-482c-82e7-a12448792bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d048580-813a-43b7-ae1a-e0b1a9c8c234", "name": "network-vif-plugged", "status": "completed", "tag": "1c3eebfc-cf3d-4a86-8be4-2f39da195acf"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:55.632453 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:55.632453 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:04:55.644215 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-8e0f80a3-98fe-47e6-b4e4-f8f24598c166 req-ccee508d-3b68-482c-82e7-a12448792bc9 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:55.649981 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-8e0f80a3-98fe-47e6-b4e4-f8f24598c166 req-ccee508d-3b68-482c-82e7-a12448792bc9 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:55.669901 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-8e0f80a3-98fe-47e6-b4e4-f8f24598c166 req-ccee508d-3b68-482c-82e7-a12448792bc9 service nova] Creating event network-vif-plugged:1c3eebfc-cf3d-4a86-8be4-2f39da195acf for instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234 on hv-cinder-82497 Jan 28 02:04:55.678018 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-8e0f80a3-98fe-47e6-b4e4-f8f24598c166 req-ccee508d-3b68-482c-82e7-a12448792bc9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055553 Jan 28 02:04:55.682130 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 300/619] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:04:55.766812 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ee68ef33-de56-4e54-bc92-a01d017d7f43 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:55.785330 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ee68ef33-de56-4e54-bc92-a01d017d7f43 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:55.791343 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ee68ef33-de56-4e54-bc92-a01d017d7f43 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:55.793049 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ee68ef33-de56-4e54-bc92-a01d017d7f43 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.369004 Jan 28 02:04:55.798673 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 320/620] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:55 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:56.102796 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-0cc604d9-4df2-4d29-ac21-0896ca7676b8 req-6d49105e-9b23-47c4-a61c-4178fe422f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706d03a1-cf66-4cdb-8271-bb94ca669ad7", "name": "network-vif-deleted", "tag": "37e6d8f1-ff0f-4f83-801f-3e5eb74019e6"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:56.104391 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:56.104391 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:04:56.118711 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-0cc604d9-4df2-4d29-ac21-0896ca7676b8 req-6d49105e-9b23-47c4-a61c-4178fe422f2b service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:56.119103 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-0cc604d9-4df2-4d29-ac21-0896ca7676b8 req-6d49105e-9b23-47c4-a61c-4178fe422f2b service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:56.132392 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-0cc604d9-4df2-4d29-ac21-0896ca7676b8 req-6d49105e-9b23-47c4-a61c-4178fe422f2b service nova] Creating event network-vif-deleted:37e6d8f1-ff0f-4f83-801f-3e5eb74019e6 for instance 706d03a1-cf66-4cdb-8271-bb94ca669ad7 on hv-cinder-82497 Jan 28 02:04:56.137875 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-0cc604d9-4df2-4d29-ac21-0896ca7676b8 req-6d49105e-9b23-47c4-a61c-4178fe422f2b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043024 Jan 28 02:04:56.139504 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 301/621] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:56.277432 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-aefdd1ee-c5cf-402a-bd19-ed24bebbe4a4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:56.278754 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-aefdd1ee-c5cf-402a-bd19-ed24bebbe4a4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:56.290957 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aefdd1ee-c5cf-402a-bd19-ed24bebbe4a4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:56.291816 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aefdd1ee-c5cf-402a-bd19-ed24bebbe4a4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:56.293039 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aefdd1ee-c5cf-402a-bd19-ed24bebbe4a4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:56.293957 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aefdd1ee-c5cf-402a-bd19-ed24bebbe4a4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:56.334405 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aefdd1ee-c5cf-402a-bd19-ed24bebbe4a4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:56.335072 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aefdd1ee-c5cf-402a-bd19-ed24bebbe4a4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:56.335851 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-aefdd1ee-c5cf-402a-bd19-ed24bebbe4a4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lazy-loading 'fault' on Instance uuid 706d03a1-cf66-4cdb-8271-bb94ca669ad7 {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:56.394038 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-aefdd1ee-c5cf-402a-bd19-ed24bebbe4a4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7dc50f676f942319f779d8f141502f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a830c3a19c3740619ece0b4ca820490e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:56.403521 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-aefdd1ee-c5cf-402a-bd19-ed24bebbe4a4 tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 200 len: 1311 microversion: 2.1 time: 0.140721 Jan 28 02:04:56.404836 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 321/622] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:56 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 1311 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:56.672680 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-25c049b5-2608-4d8f-9e9b-f3f3a3fdc65f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-94748571"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:56.673308 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-25c049b5-2608-4d8f-9e9b-f3f3a3fdc65f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:56.679551 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-25c049b5-2608-4d8f-9e9b-f3f3a3fdc65f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:56.679999 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-25c049b5-2608-4d8f-9e9b-f3f3a3fdc65f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:56.680786 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-25c049b5-2608-4d8f-9e9b-f3f3a3fdc65f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:56.681220 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-25c049b5-2608-4d8f-9e9b-f3f3a3fdc65f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:56.805320 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.network.security_group_api [None req-25c049b5-2608-4d8f-9e9b-f3f3a3fdc65f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Adding security group ea1dd302-bd0a-4977-82e4-29786b62dcd1 to port df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1 Jan 28 02:04:56.816400 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a92e5b86-6154-4c95-af71-c8a3bd47edd4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:56.817006 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a92e5b86-6154-4c95-af71-c8a3bd47edd4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:56.822996 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a92e5b86-6154-4c95-af71-c8a3bd47edd4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:56.823490 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a92e5b86-6154-4c95-af71-c8a3bd47edd4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:56.824462 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a92e5b86-6154-4c95-af71-c8a3bd47edd4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:56.825058 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a92e5b86-6154-4c95-af71-c8a3bd47edd4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:57.044296 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a92e5b86-6154-4c95-af71-c8a3bd47edd4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:57.056256 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a92e5b86-6154-4c95-af71-c8a3bd47edd4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:57.057549 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a92e5b86-6154-4c95-af71-c8a3bd47edd4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:57.058736 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a92e5b86-6154-4c95-af71-c8a3bd47edd4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.246499 Jan 28 02:04:57.061949 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 322/623] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:56 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:04:57.265949 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-25c049b5-2608-4d8f-9e9b-f3f3a3fdc65f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "POST /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/action" status: 202 len: 0 microversion: 2.1 time: 0.597071 Jan 28 02:04:57.271265 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-c24fc638-b44a-4d87-813e-fb8c47df44f9 req-1375c8f0-6645-439a-92bc-fbaadd35118f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99e0d03-1fe8-4dd7-9c5d-e67a633ab920", "tag": "df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:57.272858 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:57.272858 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:04:57.279952 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 302/624] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:04:56 2022] POST /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:04:57.282657 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-c24fc638-b44a-4d87-813e-fb8c47df44f9 req-1375c8f0-6645-439a-92bc-fbaadd35118f service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:57.283103 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-c24fc638-b44a-4d87-813e-fb8c47df44f9 req-1375c8f0-6645-439a-92bc-fbaadd35118f service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:57.286469 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-96518e61-1df7-4b4e-824a-914b3c947c52 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:57.287007 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-96518e61-1df7-4b4e-824a-914b3c947c52 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:57.293647 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-96518e61-1df7-4b4e-824a-914b3c947c52 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:57.294134 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-96518e61-1df7-4b4e-824a-914b3c947c52 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:57.295447 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-96518e61-1df7-4b4e-824a-914b3c947c52 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:57.295927 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-96518e61-1df7-4b4e-824a-914b3c947c52 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:57.297668 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-c24fc638-b44a-4d87-813e-fb8c47df44f9 req-1375c8f0-6645-439a-92bc-fbaadd35118f service nova] Creating event network-changed:df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1 for instance b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 on hv-cinder-82497 Jan 28 02:04:57.304467 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-c24fc638-b44a-4d87-813e-fb8c47df44f9 req-1375c8f0-6645-439a-92bc-fbaadd35118f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036883 Jan 28 02:04:57.305885 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 323/625] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:57.422184 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-914a02f7-0a44-45ac-b0d0-94cce9f63bdc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:57.422890 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-914a02f7-0a44-45ac-b0d0-94cce9f63bdc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] [instance: 706d03a1-cf66-4cdb-8271-bb94ca669ad7] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:57.434328 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-914a02f7-0a44-45ac-b0d0-94cce9f63bdc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:57.436549 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-914a02f7-0a44-45ac-b0d0-94cce9f63bdc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:57.440689 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-914a02f7-0a44-45ac-b0d0-94cce9f63bdc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:57.441311 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-914a02f7-0a44-45ac-b0d0-94cce9f63bdc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:57.457100 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-96518e61-1df7-4b4e-824a-914b3c947c52 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:57.465532 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-96518e61-1df7-4b4e-824a-914b3c947c52 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1760 microversion: 2.1 time: 0.182614 Jan 28 02:04:57.473674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-914a02f7-0a44-45ac-b0d0-94cce9f63bdc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] HTTP exception thrown: Instance 706d03a1-cf66-4cdb-8271-bb94ca669ad7 could not be found. Jan 28 02:04:57.475649 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-914a02f7-0a44-45ac-b0d0-94cce9f63bdc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] Returning 404 to user: Instance 706d03a1-cf66-4cdb-8271-bb94ca669ad7 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:57.476947 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-914a02f7-0a44-45ac-b0d0-94cce9f63bdc tempest-ServerRescueNegativeTestJSON-1068127003 tempest-ServerRescueNegativeTestJSON-1068127003-project] 10.222.0.77 "GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7" status: 404 len: 111 microversion: 2.1 time: 0.059219 Jan 28 02:04:57.479589 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 303/626] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:57 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1760 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:57.479969 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 324/627] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:57 2022] GET /compute/v2.1/servers/706d03a1-cf66-4cdb-8271-bb94ca669ad7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:04:58.078517 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e050baaa-688f-47cb-a989-8693316002b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:58.079269 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e050baaa-688f-47cb-a989-8693316002b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:58.089917 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e050baaa-688f-47cb-a989-8693316002b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:58.090661 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e050baaa-688f-47cb-a989-8693316002b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:58.092249 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e050baaa-688f-47cb-a989-8693316002b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:58.092889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e050baaa-688f-47cb-a989-8693316002b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:58.526615 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-e050baaa-688f-47cb-a989-8693316002b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:58.535973 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-e050baaa-688f-47cb-a989-8693316002b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:58.537905 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-e050baaa-688f-47cb-a989-8693316002b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:58.539243 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-e050baaa-688f-47cb-a989-8693316002b1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1807 microversion: 2.20 time: 0.466545 Jan 28 02:04:58.539641 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 304/628] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:58 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1807 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:59.558896 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-224411b2-327e-45f9-ad71-a583accfe66a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:59.560189 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-224411b2-327e-45f9-ad71-a583accfe66a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:59.567153 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-224411b2-327e-45f9-ad71-a583accfe66a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:59.567602 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-224411b2-327e-45f9-ad71-a583accfe66a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:59.568389 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-224411b2-327e-45f9-ad71-a583accfe66a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:59.568820 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-224411b2-327e-45f9-ad71-a583accfe66a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:59.724743 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-224411b2-327e-45f9-ad71-a583accfe66a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:59.735536 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-224411b2-327e-45f9-ad71-a583accfe66a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:59.737204 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-224411b2-327e-45f9-ad71-a583accfe66a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:59.738443 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-224411b2-327e-45f9-ad71-a583accfe66a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1794 microversion: 2.20 time: 0.183657 Jan 28 02:04:59.739324 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 325/629] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:59 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1794 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:02.154237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-076da7e4-760d-49e0-9822-453360229452 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Action: 'create', calling method: .version_select at 0x7f08d5e25ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-803947788"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:02.442115 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-076da7e4-760d-49e0-9822-453360229452 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.397562 Jan 28 02:05:02.442731 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 305/630] 10.222.0.77 () {60 vars in 1154 bytes} [Fri Jan 28 02:05:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 399 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 28 02:05:02.453784 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e44da860-43aa-4713-b0ee-3f2e2af33256 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5d9d430>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:02.505544 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e44da860-43aa-4713-b0ee-3f2e2af33256 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84" status: 200 len: 344 microversion: 2.1 time: 0.055890 Jan 28 02:05:02.506146 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 326/631] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:02 2022] GET /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:03.517825 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-0b820840-4a31-4c74-8459-fbfbd7481f09 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5e2fdc0>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:03.570298 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-0b820840-4a31-4c74-8459-fbfbd7481f09 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84" status: 200 len: 345 microversion: 2.1 time: 0.056120 Jan 28 02:05:03.570888 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 306/632] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:03 2022] GET /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:03.581970 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c655b01c-2923-4f72-83e8-d01ec49b5d17 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Action: 'create', calling method: .version_select at 0x7f08d5d69b80>, body: {"snapshot": {"volume_id": "df955a51-40ea-4f52-af60-ad399687bd84", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-989538293"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:03.719331 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c655b01c-2923-4f72-83e8-d01ec49b5d17 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.140952 Jan 28 02:05:03.720248 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 327/633] 10.222.0.77 () {60 vars in 1161 bytes} [Fri Jan 28 02:05:03 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:03.729469 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9401699e-5929-420f-b04f-614622e541bb tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5f5e430>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:03.759341 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9401699e-5929-420f-b04f-614622e541bb tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a" status: 200 len: 286 microversion: 2.1 time: 0.033457 Jan 28 02:05:03.759915 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 307/634] 10.222.0.77 () {58 vars in 1250 bytes} [Fri Jan 28 02:05:03 2022] GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:03.769390 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-dbbccb92-d954-4533-a84a-fba8c82edb45 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5dfdb80>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:03.798206 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-dbbccb92-d954-4533-a84a-fba8c82edb45 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032386 Jan 28 02:05:03.798764 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 328/635] 10.222.0.77 () {58 vars in 1139 bytes} [Fri Jan 28 02:05:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:03.808738 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f0f21fb3-6617-425f-b182-42a581b33734 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5e2f430>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:03.837844 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f0f21fb3-6617-425f-b182-42a581b33734 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a" status: 200 len: 286 microversion: 2.1 time: 0.032694 Jan 28 02:05:03.838428 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 308/636] 10.222.0.77 () {58 vars in 1250 bytes} [Fri Jan 28 02:05:03 2022] GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:04.849082 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-54861da2-049f-41d9-93bf-30bff8993d86 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5d69c10>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:04.878228 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-54861da2-049f-41d9-93bf-30bff8993d86 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a" status: 200 len: 286 microversion: 2.1 time: 0.032496 Jan 28 02:05:04.878787 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 329/637] 10.222.0.77 () {58 vars in 1250 bytes} [Fri Jan 28 02:05:04 2022] GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:05.889449 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6d638b2d-8a55-44e1-aac2-5330a1c6d029 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5d96940>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:05.925632 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6d638b2d-8a55-44e1-aac2-5330a1c6d029 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a" status: 200 len: 286 microversion: 2.1 time: 0.039608 Jan 28 02:05:05.926247 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 309/638] 10.222.0.77 () {58 vars in 1250 bytes} [Fri Jan 28 02:05:05 2022] GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:06.937246 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3e7c31df-593d-4a6a-b618-c474f9bfea65 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d661daf0>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:06.965682 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3e7c31df-593d-4a6a-b618-c474f9bfea65 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a" status: 200 len: 287 microversion: 2.1 time: 0.032735 Jan 28 02:05:06.966296 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 330/639] 10.222.0.77 () {58 vars in 1250 bytes} [Fri Jan 28 02:05:06 2022] GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:06.976084 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-327afd3f-707c-4e28-b430-f876628fd28b tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5d965e0>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:07.029977 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-327afd3f-707c-4e28-b430-f876628fd28b tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "DELETE /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a" status: 202 len: 0 microversion: 2.1 time: 0.057228 Jan 28 02:05:07.030671 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 310/640] 10.222.0.77 () {58 vars in 1253 bytes} [Fri Jan 28 02:05:06 2022] DELETE /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:05:07.038404 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-9a654560-049c-43ff-a8ac-4687ab79880f tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5daad30>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:07.067897 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-9a654560-049c-43ff-a8ac-4687ab79880f tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a" status: 200 len: 286 microversion: 2.1 time: 0.032890 Jan 28 02:05:07.068459 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 331/641] 10.222.0.77 () {58 vars in 1250 bytes} [Fri Jan 28 02:05:07 2022] GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:08.081207 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-48ebe557-632c-4dc2-83af-eeb99336e833 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5dec8b0>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:08.104720 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-48ebe557-632c-4dc2-83af-eeb99336e833 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] HTTP exception thrown: Snapshot ae982d37-954b-460c-9eef-158ed4b6802a could not be found. Jan 28 02:05:08.105351 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-48ebe557-632c-4dc2-83af-eeb99336e833 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Returning 404 to user: Snapshot ae982d37-954b-460c-9eef-158ed4b6802a could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:05:08.106255 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-48ebe557-632c-4dc2-83af-eeb99336e833 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a" status: 404 len: 111 microversion: 2.1 time: 0.030548 Jan 28 02:05:08.106948 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 311/642] 10.222.0.77 () {58 vars in 1250 bytes} [Fri Jan 28 02:05:08 2022] GET /compute/v2.1/os-snapshots/ae982d37-954b-460c-9eef-158ed4b6802a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:05:08.116717 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3c8fdd27-c78c-4fa6-90a0-705f54518062 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5e070d0>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:08.180784 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3c8fdd27-c78c-4fa6-90a0-705f54518062 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84" status: 202 len: 0 microversion: 2.1 time: 0.068947 Jan 28 02:05:08.181400 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 332/643] 10.222.0.77 () {58 vars in 1247 bytes} [Fri Jan 28 02:05:08 2022] DELETE /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:05:08.190756 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1e47b614-c104-43fe-b76e-140c95e381db tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5d96280>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:08.250621 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1e47b614-c104-43fe-b76e-140c95e381db tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84" status: 200 len: 344 microversion: 2.1 time: 0.064173 Jan 28 02:05:08.251428 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 312/644] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:08 2022] GET /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:09.262029 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1303f0fa-1e15-43fa-af31-32942c9fe8d9 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5dfd5e0>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:09.293725 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-1303f0fa-1e15-43fa-af31-32942c9fe8d9 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] HTTP exception thrown: Volume df955a51-40ea-4f52-af60-ad399687bd84 could not be found. Jan 28 02:05:09.294370 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1303f0fa-1e15-43fa-af31-32942c9fe8d9 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Returning 404 to user: Volume df955a51-40ea-4f52-af60-ad399687bd84 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:05:09.295266 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1303f0fa-1e15-43fa-af31-32942c9fe8d9 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84" status: 404 len: 109 microversion: 2.1 time: 0.036856 Jan 28 02:05:09.295878 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 333/645] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:09 2022] GET /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:05:09.304599 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b0edad9e-462e-484d-81c6-d1080eb1e1a0 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d5d964c0>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:09.332767 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-b0edad9e-462e-484d-81c6-d1080eb1e1a0 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] HTTP exception thrown: Volume df955a51-40ea-4f52-af60-ad399687bd84 could not be found. Jan 28 02:05:09.333367 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b0edad9e-462e-484d-81c6-d1080eb1e1a0 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Returning 404 to user: Volume df955a51-40ea-4f52-af60-ad399687bd84 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:05:09.334302 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b0edad9e-462e-484d-81c6-d1080eb1e1a0 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84" status: 404 len: 109 microversion: 2.1 time: 0.033289 Jan 28 02:05:09.334772 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 313/646] 10.222.0.77 () {58 vars in 1247 bytes} [Fri Jan 28 02:05:09 2022] DELETE /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:05:09.344013 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-13350551-5f6b-41ec-9237-d860c2d29ee7 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Calling method '.version_select at 0x7f08d668dc10>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:09.370702 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-13350551-5f6b-41ec-9237-d860c2d29ee7 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] HTTP exception thrown: Volume df955a51-40ea-4f52-af60-ad399687bd84 could not be found. Jan 28 02:05:09.371308 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-13350551-5f6b-41ec-9237-d860c2d29ee7 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] Returning 404 to user: Volume df955a51-40ea-4f52-af60-ad399687bd84 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:05:09.372132 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-13350551-5f6b-41ec-9237-d860c2d29ee7 tempest-VolumesSnapshotsTestJSON-1249566884 tempest-VolumesSnapshotsTestJSON-1249566884-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84" status: 404 len: 109 microversion: 2.1 time: 0.033174 Jan 28 02:05:09.372665 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 334/647] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:09 2022] GET /compute/v2.1/os-volumes/df955a51-40ea-4f52-af60-ad399687bd84 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:05:10.729904 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-cbea4996-de71-4224-9004-2d1548e34edd tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] Action: 'create', calling method: .version_select at 0x7f08d5d96b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1510206579", "metadata": {"Type": "work"}}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:11.021819 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-cbea4996-de71-4224-9004-2d1548e34edd tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.403729 Jan 28 02:05:11.022808 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 314/648] 10.222.0.77 () {60 vars in 1155 bytes} [Fri Jan 28 02:05:10 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 406 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 28 02:05:11.033863 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5ce7eeac-208f-4ab9-ac83-ea5029c35428 tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] Calling method '.version_select at 0x7f08d5daa280>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:11.097911 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-5ce7eeac-208f-4ab9-ac83-ea5029c35428 tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/628f7ad0-b7b3-4285-98f6-b7c980498ae8" status: 200 len: 353 microversion: 2.1 time: 0.068353 Jan 28 02:05:11.098549 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 335/649] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:11 2022] GET /compute/v2.1/os-volumes/628f7ad0-b7b3-4285-98f6-b7c980498ae8 => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:05:12.110520 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-dd0be4c6-638b-4159-9c99-9e32e9cf420d tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] Calling method '.version_select at 0x7f08d5e2f430>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:12.161716 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-dd0be4c6-638b-4159-9c99-9e32e9cf420d tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/628f7ad0-b7b3-4285-98f6-b7c980498ae8" status: 200 len: 354 microversion: 2.1 time: 0.054837 Jan 28 02:05:12.162309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 315/650] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:12 2022] GET /compute/v2.1/os-volumes/628f7ad0-b7b3-4285-98f6-b7c980498ae8 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:12.172788 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-10fb57bc-b918-441c-acc7-04be577a6ff6 tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] Calling method '.version_select at 0x7f08d5d69820>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:12.225679 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-10fb57bc-b918-441c-acc7-04be577a6ff6 tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/628f7ad0-b7b3-4285-98f6-b7c980498ae8" status: 200 len: 354 microversion: 2.1 time: 0.056365 Jan 28 02:05:12.226455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 336/651] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:12 2022] GET /compute/v2.1/os-volumes/628f7ad0-b7b3-4285-98f6-b7c980498ae8 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:12.238667 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-be3d3baf-0cd5-4fbd-b6ee-0f28495df946 tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] Calling method '.version_select at 0x7f08d6968940>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:12.308376 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-be3d3baf-0cd5-4fbd-b6ee-0f28495df946 tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/628f7ad0-b7b3-4285-98f6-b7c980498ae8" status: 202 len: 0 microversion: 2.1 time: 0.073774 Jan 28 02:05:12.308938 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 316/652] 10.222.0.77 () {58 vars in 1247 bytes} [Fri Jan 28 02:05:12 2022] DELETE /compute/v2.1/os-volumes/628f7ad0-b7b3-4285-98f6-b7c980498ae8 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:05:12.318157 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-77f4e6a2-e0a5-4d00-9f96-2ac61a0227e7 tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] Calling method '.version_select at 0x7f08d5daa3a0>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:12.380656 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-77f4e6a2-e0a5-4d00-9f96-2ac61a0227e7 tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/628f7ad0-b7b3-4285-98f6-b7c980498ae8" status: 200 len: 353 microversion: 2.1 time: 0.066676 Jan 28 02:05:12.381220 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 337/653] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:12 2022] GET /compute/v2.1/os-volumes/628f7ad0-b7b3-4285-98f6-b7c980498ae8 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:13.397064 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2a796bb2-fb8e-4cb0-8a93-5efe8231e575 tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] Calling method '.version_select at 0x7f08d5d96820>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:13.429494 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-2a796bb2-fb8e-4cb0-8a93-5efe8231e575 tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] HTTP exception thrown: Volume 628f7ad0-b7b3-4285-98f6-b7c980498ae8 could not be found. Jan 28 02:05:13.430124 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2a796bb2-fb8e-4cb0-8a93-5efe8231e575 tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] Returning 404 to user: Volume 628f7ad0-b7b3-4285-98f6-b7c980498ae8 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:05:13.430954 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2a796bb2-fb8e-4cb0-8a93-5efe8231e575 tempest-VolumesGetTestJSON-461721482 tempest-VolumesGetTestJSON-461721482-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/628f7ad0-b7b3-4285-98f6-b7c980498ae8" status: 404 len: 109 microversion: 2.1 time: 0.040549 Jan 28 02:05:13.431529 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 317/654] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:13 2022] GET /compute/v2.1/os-volumes/628f7ad0-b7b3-4285-98f6-b7c980498ae8 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:05:16.627084 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6d653d31-eccb-4f3d-bec8-947c59daac01 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] Calling method '.version_select at 0x7f08d5d69d30>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:16.682440 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6d653d31-eccb-4f3d-bec8-947c59daac01 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/9b1e2697-436a-4258-8ff9-2f8e19697964" status: 200 len: 351 microversion: 2.1 time: 0.058883 Jan 28 02:05:16.682955 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 338/655] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:16 2022] GET /compute/v2.1/os-volumes/9b1e2697-436a-4258-8ff9-2f8e19697964 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:18.130353 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-da793a9b-b2b6-41f4-aafd-e047cbf9e107 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] Calling method '.version_select at 0x7f08d5d96d30>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:18.188297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-da793a9b-b2b6-41f4-aafd-e047cbf9e107 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/db52358a-abb2-4a95-a313-abea9a737349" status: 200 len: 350 microversion: 2.1 time: 0.062157 Jan 28 02:05:18.189342 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 318/656] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:18 2022] GET /compute/v2.1/os-volumes/db52358a-abb2-4a95-a313-abea9a737349 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:05:19.577099 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-925a7918-0ad9-42b5-98ff-b5b9eaf499cd tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] Calling method '.version_select at 0x7f08d5c5b160>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:19.642166 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-925a7918-0ad9-42b5-98ff-b5b9eaf499cd tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/317c9f35-857b-450d-b7ff-2f40d8e78085" status: 200 len: 351 microversion: 2.1 time: 0.069812 Jan 28 02:05:19.643277 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 339/657] 10.222.0.77 () {58 vars in 1244 bytes} [Fri Jan 28 02:05:19 2022] GET /compute/v2.1/os-volumes/317c9f35-857b-450d-b7ff-2f40d8e78085 => generated 351 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:19.658596 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1c96360a-73b8-4988-ac76-53c5cd3765fd tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] Calling method '.version_select at 0x7f08d5decb80>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:19.770114 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1c96360a-73b8-4988-ac76-53c5cd3765fd tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] 10.222.0.77 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.118284 Jan 28 02:05:19.770692 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 319/658] 10.222.0.77 () {58 vars in 1133 bytes} [Fri Jan 28 02:05:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:19.783028 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-fd146cd3-492b-4bbb-b0b8-c473d98091fb tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] Calling method '.version_select at 0x7f08d5dfd9d0>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:19.894606 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-fd146cd3-492b-4bbb-b0b8-c473d98091fb tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] 10.222.0.77 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.114964 Jan 28 02:05:19.895196 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 340/659] 10.222.0.77 () {58 vars in 1148 bytes} [Fri Jan 28 02:05:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:19.911492 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3f330a46-1679-4870-870a-d461e4989e11 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] Calling method '.version_select at 0x7f08d5e06430>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:20.005576 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3f330a46-1679-4870-870a-d461e4989e11 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] 10.222.0.77 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.102139 Jan 28 02:05:20.006397 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 320/660] 10.222.0.77 () {58 vars in 1133 bytes} [Fri Jan 28 02:05:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:20.018812 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0e82a1b2-223e-47c3-bdff-5aeb5411c052 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] Calling method '.version_select at 0x7f08d5dcb550>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:20.117989 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0e82a1b2-223e-47c3-bdff-5aeb5411c052 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] 10.222.0.77 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.104276 Jan 28 02:05:20.118654 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 341/661] 10.222.0.77 () {58 vars in 1166 bytes} [Fri Jan 28 02:05:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:20.131771 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4bf94d3d-0389-46ce-b9e1-98b359720537 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] Calling method '.version_select at 0x7f08d5e06ca0>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:20.222431 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ee6b1eec-602e-470d-b001-97d2d83667a2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:20.223596 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ee6b1eec-602e-470d-b001-97d2d83667a2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:20.235094 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ee6b1eec-602e-470d-b001-97d2d83667a2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:20.236291 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ee6b1eec-602e-470d-b001-97d2d83667a2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:20.237674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ee6b1eec-602e-470d-b001-97d2d83667a2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:20.238744 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ee6b1eec-602e-470d-b001-97d2d83667a2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:20.256864 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4bf94d3d-0389-46ce-b9e1-98b359720537 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.128335 Jan 28 02:05:20.262355 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 321/662] 10.222.0.77 () {58 vars in 1169 bytes} [Fri Jan 28 02:05:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:05:20.281101 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-903d0f6a-08df-4b4d-92a8-b09dd20a6bf7 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] Calling method '.version_select at 0x7f08d5e25e50>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:20.362593 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ee6b1eec-602e-470d-b001-97d2d83667a2 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "POST /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/action" status: 202 len: 0 microversion: 2.1 time: 0.144471 Jan 28 02:05:20.363316 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 342/663] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:20 2022] POST /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:05:20.373089 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-83cb0817-e926-4c66-8463-2df7eb448e96 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:20.374029 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-83cb0817-e926-4c66-8463-2df7eb448e96 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:20.380907 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-83cb0817-e926-4c66-8463-2df7eb448e96 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:20.381574 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-83cb0817-e926-4c66-8463-2df7eb448e96 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:20.382497 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-83cb0817-e926-4c66-8463-2df7eb448e96 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:20.383000 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-83cb0817-e926-4c66-8463-2df7eb448e96 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:20.393328 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-903d0f6a-08df-4b4d-92a8-b09dd20a6bf7 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.118131 Jan 28 02:05:20.394406 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 322/664] 10.222.0.77 () {58 vars in 1154 bytes} [Fri Jan 28 02:05:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:20.408574 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-64d4991a-ceb7-481d-8fd0-c7fe4baab9bd tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] Calling method '.version_select at 0x7f08d6968940>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:20.510974 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-64d4991a-ceb7-481d-8fd0-c7fe4baab9bd tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.107687 Jan 28 02:05:20.512065 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 323/665] 10.222.0.77 () {58 vars in 1187 bytes} [Fri Jan 28 02:05:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:20.523763 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7e0d17e9-43a6-4085-85e7-90f33e4ed542 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] Calling method '.version_select at 0x7f08d5d96040>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:20.571464 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-83cb0817-e926-4c66-8463-2df7eb448e96 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:20.580275 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-83cb0817-e926-4c66-8463-2df7eb448e96 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1752 microversion: 2.1 time: 0.212028 Jan 28 02:05:20.582159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 343/666] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:20 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:05:20.629559 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7e0d17e9-43a6-4085-85e7-90f33e4ed542 tempest-VolumesTestJSON-377938836 tempest-VolumesTestJSON-377938836-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.109979 Jan 28 02:05:20.630265 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 324/667] 10.222.0.77 () {58 vars in 1154 bytes} [Fri Jan 28 02:05:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:05:21.600243 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0c499280-4dbf-448e-8320-55011842fd92 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:21.600868 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0c499280-4dbf-448e-8320-55011842fd92 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:21.607335 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0c499280-4dbf-448e-8320-55011842fd92 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:21.607779 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0c499280-4dbf-448e-8320-55011842fd92 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:21.608581 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0c499280-4dbf-448e-8320-55011842fd92 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:21.609003 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0c499280-4dbf-448e-8320-55011842fd92 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:21.741235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0c499280-4dbf-448e-8320-55011842fd92 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:21.752852 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0c499280-4dbf-448e-8320-55011842fd92 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.156585 Jan 28 02:05:21.753447 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 344/668] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:21 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:22.773782 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4932ae5f-f234-4823-9e31-1cc76a791ab5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:22.774536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4932ae5f-f234-4823-9e31-1cc76a791ab5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:22.783538 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4932ae5f-f234-4823-9e31-1cc76a791ab5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:22.783980 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4932ae5f-f234-4823-9e31-1cc76a791ab5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:22.784769 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4932ae5f-f234-4823-9e31-1cc76a791ab5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:22.785197 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4932ae5f-f234-4823-9e31-1cc76a791ab5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:22.912561 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4932ae5f-f234-4823-9e31-1cc76a791ab5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:22.921163 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4932ae5f-f234-4823-9e31-1cc76a791ab5 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.151769 Jan 28 02:05:22.921529 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 325/669] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:22 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:05:23.939098 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-dccc8504-2272-4946-9199-189cb9bd8cb9 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:23.939732 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-dccc8504-2272-4946-9199-189cb9bd8cb9 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:23.946324 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dccc8504-2272-4946-9199-189cb9bd8cb9 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:23.946770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dccc8504-2272-4946-9199-189cb9bd8cb9 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:23.947559 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dccc8504-2272-4946-9199-189cb9bd8cb9 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:23.947992 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dccc8504-2272-4946-9199-189cb9bd8cb9 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:24.086672 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dccc8504-2272-4946-9199-189cb9bd8cb9 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:24.097040 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-dccc8504-2272-4946-9199-189cb9bd8cb9 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.161436 Jan 28 02:05:24.098048 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 345/670] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:23 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:25.116960 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-0addc24b-c646-4402-9ac0-9c42a0735e46 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:25.117908 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-0addc24b-c646-4402-9ac0-9c42a0735e46 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:25.126587 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0addc24b-c646-4402-9ac0-9c42a0735e46 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:25.127034 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0addc24b-c646-4402-9ac0-9c42a0735e46 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:25.128098 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0addc24b-c646-4402-9ac0-9c42a0735e46 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:25.128791 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0addc24b-c646-4402-9ac0-9c42a0735e46 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:25.287993 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-0addc24b-c646-4402-9ac0-9c42a0735e46 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:25.296449 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-0addc24b-c646-4402-9ac0-9c42a0735e46 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.183391 Jan 28 02:05:25.297007 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 326/671] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:25 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:26.319386 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-00ea7f3a-f890-40a1-a040-62f4c2c20a00 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:26.321336 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-00ea7f3a-f890-40a1-a040-62f4c2c20a00 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:26.328578 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-00ea7f3a-f890-40a1-a040-62f4c2c20a00 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:26.329095 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-00ea7f3a-f890-40a1-a040-62f4c2c20a00 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:26.329940 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-00ea7f3a-f890-40a1-a040-62f4c2c20a00 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:26.330369 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-00ea7f3a-f890-40a1-a040-62f4c2c20a00 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:26.485789 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-00ea7f3a-f890-40a1-a040-62f4c2c20a00 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:26.500320 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-00ea7f3a-f890-40a1-a040-62f4c2c20a00 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.187810 Jan 28 02:05:26.502349 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 346/672] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:26 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:27.520685 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-cb5e6364-ae3c-4ead-a043-fe2b05c9f56a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:27.521388 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-cb5e6364-ae3c-4ead-a043-fe2b05c9f56a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:27.527675 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cb5e6364-ae3c-4ead-a043-fe2b05c9f56a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:27.528215 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cb5e6364-ae3c-4ead-a043-fe2b05c9f56a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:27.529081 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cb5e6364-ae3c-4ead-a043-fe2b05c9f56a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:27.529653 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cb5e6364-ae3c-4ead-a043-fe2b05c9f56a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:27.676932 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-cb5e6364-ae3c-4ead-a043-fe2b05c9f56a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:27.686625 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-cb5e6364-ae3c-4ead-a043-fe2b05c9f56a tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.170721 Jan 28 02:05:27.687543 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 327/673] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:27 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:28.704873 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-380db8fa-8cdd-487c-abf5-8ff9c37959f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:28.705581 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-380db8fa-8cdd-487c-abf5-8ff9c37959f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:28.712318 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-380db8fa-8cdd-487c-abf5-8ff9c37959f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:28.712756 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-380db8fa-8cdd-487c-abf5-8ff9c37959f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:28.713557 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-380db8fa-8cdd-487c-abf5-8ff9c37959f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:28.714007 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-380db8fa-8cdd-487c-abf5-8ff9c37959f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:28.854083 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-380db8fa-8cdd-487c-abf5-8ff9c37959f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:28.863000 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-380db8fa-8cdd-487c-abf5-8ff9c37959f6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.162622 Jan 28 02:05:28.863576 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 347/674] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:28 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:29.880410 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-31a7e838-d27d-424d-96cb-cf749a5d9745 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:29.881076 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-31a7e838-d27d-424d-96cb-cf749a5d9745 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:29.887101 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-31a7e838-d27d-424d-96cb-cf749a5d9745 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:29.887599 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-31a7e838-d27d-424d-96cb-cf749a5d9745 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:29.888311 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-31a7e838-d27d-424d-96cb-cf749a5d9745 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:29.888764 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-31a7e838-d27d-424d-96cb-cf749a5d9745 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:30.059159 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-31a7e838-d27d-424d-96cb-cf749a5d9745 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:30.073236 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-31a7e838-d27d-424d-96cb-cf749a5d9745 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.196013 Jan 28 02:05:30.074237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 328/675] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:29 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:31.093628 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bb0085b2-d7d7-439f-a5a4-f7364b5bfb18 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:31.094846 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bb0085b2-d7d7-439f-a5a4-f7364b5bfb18 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:31.100939 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bb0085b2-d7d7-439f-a5a4-f7364b5bfb18 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:31.101411 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bb0085b2-d7d7-439f-a5a4-f7364b5bfb18 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:31.102252 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bb0085b2-d7d7-439f-a5a4-f7364b5bfb18 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:31.102678 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bb0085b2-d7d7-439f-a5a4-f7364b5bfb18 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:31.246596 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-bb0085b2-d7d7-439f-a5a4-f7364b5bfb18 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:31.256713 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-bb0085b2-d7d7-439f-a5a4-f7364b5bfb18 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.169008 Jan 28 02:05:31.257366 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 348/676] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:31 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:32.274853 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4fcab2b6-2276-4f60-92cb-4523c379b596 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:32.275458 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4fcab2b6-2276-4f60-92cb-4523c379b596 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:32.281320 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4fcab2b6-2276-4f60-92cb-4523c379b596 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:32.282441 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4fcab2b6-2276-4f60-92cb-4523c379b596 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:32.283215 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4fcab2b6-2276-4f60-92cb-4523c379b596 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:32.283732 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4fcab2b6-2276-4f60-92cb-4523c379b596 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:32.420401 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4fcab2b6-2276-4f60-92cb-4523c379b596 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:32.431683 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4fcab2b6-2276-4f60-92cb-4523c379b596 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.160579 Jan 28 02:05:32.432267 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 329/677] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:32 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:33.453717 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-dd31a306-bd20-4220-890d-b9d0473d2184 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:33.454794 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-dd31a306-bd20-4220-890d-b9d0473d2184 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:33.468134 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dd31a306-bd20-4220-890d-b9d0473d2184 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:33.468644 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dd31a306-bd20-4220-890d-b9d0473d2184 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:33.469977 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dd31a306-bd20-4220-890d-b9d0473d2184 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:33.470407 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dd31a306-bd20-4220-890d-b9d0473d2184 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:33.619423 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dd31a306-bd20-4220-890d-b9d0473d2184 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:33.632869 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-dd31a306-bd20-4220-890d-b9d0473d2184 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.185267 Jan 28 02:05:33.634074 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 349/678] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:33 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:34.650904 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6dce4473-1bde-4634-8b06-32dd6c01f754 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:34.651509 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6dce4473-1bde-4634-8b06-32dd6c01f754 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:34.657786 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6dce4473-1bde-4634-8b06-32dd6c01f754 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:34.658233 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6dce4473-1bde-4634-8b06-32dd6c01f754 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:34.659052 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6dce4473-1bde-4634-8b06-32dd6c01f754 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:34.659549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6dce4473-1bde-4634-8b06-32dd6c01f754 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:34.799219 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6dce4473-1bde-4634-8b06-32dd6c01f754 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:34.810758 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6dce4473-1bde-4634-8b06-32dd6c01f754 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.163579 Jan 28 02:05:34.821349 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 330/679] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:34 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:35.833483 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-91a46c8b-a0af-4bb2-ae39-133b60d99597 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:35.834104 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-91a46c8b-a0af-4bb2-ae39-133b60d99597 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:35.842224 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-91a46c8b-a0af-4bb2-ae39-133b60d99597 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:35.843029 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-91a46c8b-a0af-4bb2-ae39-133b60d99597 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:35.843858 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-91a46c8b-a0af-4bb2-ae39-133b60d99597 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:35.844321 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-91a46c8b-a0af-4bb2-ae39-133b60d99597 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:36.015297 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-91a46c8b-a0af-4bb2-ae39-133b60d99597 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:36.027794 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-91a46c8b-a0af-4bb2-ae39-133b60d99597 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.202773 Jan 28 02:05:36.028839 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 350/680] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:35 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:37.045283 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1a28775a-fad7-4f7b-a80d-c930e9a2fe14 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:37.046045 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1a28775a-fad7-4f7b-a80d-c930e9a2fe14 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:37.052933 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1a28775a-fad7-4f7b-a80d-c930e9a2fe14 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:37.053384 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1a28775a-fad7-4f7b-a80d-c930e9a2fe14 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:37.054180 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1a28775a-fad7-4f7b-a80d-c930e9a2fe14 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:37.054790 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1a28775a-fad7-4f7b-a80d-c930e9a2fe14 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:37.221138 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-1a28775a-fad7-4f7b-a80d-c930e9a2fe14 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:37.238169 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1a28775a-fad7-4f7b-a80d-c930e9a2fe14 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.196802 Jan 28 02:05:37.239184 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 331/681] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:37 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:38.188202 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-deaa0db6-402d-47cb-b348-dab54928ef02 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:38.188700 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-deaa0db6-402d-47cb-b348-dab54928ef02 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:38.195804 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-deaa0db6-402d-47cb-b348-dab54928ef02 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.196506 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-deaa0db6-402d-47cb-b348-dab54928ef02 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.199016 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-deaa0db6-402d-47cb-b348-dab54928ef02 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.199815 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-deaa0db6-402d-47cb-b348-dab54928ef02 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.237924 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-deaa0db6-402d-47cb-b348-dab54928ef02 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/os-volume_attachments/18335c75-9d5b-4fbb-9916-cd9d63977fc9" status: 200 len: 194 microversion: 2.20 time: 0.053843 Jan 28 02:05:38.239214 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 351/682] 10.222.0.77 () {60 vars in 1453 bytes} [Fri Jan 28 02:05:38 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/os-volume_attachments/18335c75-9d5b-4fbb-9916-cd9d63977fc9 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:38.264138 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-975bce7f-0c25-4074-8dec-5950521711dd tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:38.264889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-975bce7f-0c25-4074-8dec-5950521711dd tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:38.276106 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-975bce7f-0c25-4074-8dec-5950521711dd tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.276561 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-975bce7f-0c25-4074-8dec-5950521711dd tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.277367 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-975bce7f-0c25-4074-8dec-5950521711dd tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.277827 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-975bce7f-0c25-4074-8dec-5950521711dd tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.320868 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ec6e798a-093c-48a3-80f6-28ae46f31e09 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:38.321386 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ec6e798a-093c-48a3-80f6-28ae46f31e09 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:38.331015 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec6e798a-093c-48a3-80f6-28ae46f31e09 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.331666 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec6e798a-093c-48a3-80f6-28ae46f31e09 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.333698 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec6e798a-093c-48a3-80f6-28ae46f31e09 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.334697 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec6e798a-093c-48a3-80f6-28ae46f31e09 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.449382 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-ec6e798a-093c-48a3-80f6-28ae46f31e09 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lazy-loading 'services' on Instance uuid 9d048580-813a-43b7-ae1a-e0b1a9c8c234 {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:05:38.483176 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-975bce7f-0c25-4074-8dec-5950521711dd tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:38.497067 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-975bce7f-0c25-4074-8dec-5950521711dd tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.236784 Jan 28 02:05:38.507701 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 332/683] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:38 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:38.540293 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ec6e798a-093c-48a3-80f6-28ae46f31e09 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "DELETE /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/os-volume_attachments/18335c75-9d5b-4fbb-9916-cd9d63977fc9" status: 202 len: 0 microversion: 2.20 time: 0.223244 Jan 28 02:05:38.541205 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 352/684] 10.222.0.77 () {60 vars in 1456 bytes} [Fri Jan 28 02:05:38 2022] DELETE /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/os-volume_attachments/18335c75-9d5b-4fbb-9916-cd9d63977fc9 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:05:38.549411 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f04318fa-d9a7-47c6-a656-efc14f1164e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:38.550294 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f04318fa-d9a7-47c6-a656-efc14f1164e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:38.558508 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f04318fa-d9a7-47c6-a656-efc14f1164e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.558947 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f04318fa-d9a7-47c6-a656-efc14f1164e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.560984 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f04318fa-d9a7-47c6-a656-efc14f1164e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.561593 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f04318fa-d9a7-47c6-a656-efc14f1164e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.599649 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f04318fa-d9a7-47c6-a656-efc14f1164e3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054184 Jan 28 02:05:38.604508 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 333/685] 10.222.0.77 () {60 vars in 1342 bytes} [Fri Jan 28 02:05:38 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:39.517907 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-27c8831e-db4a-4c0d-9d50-c69871134b0f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:39.521029 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-27c8831e-db4a-4c0d-9d50-c69871134b0f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:39.535598 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-27c8831e-db4a-4c0d-9d50-c69871134b0f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:39.536634 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-27c8831e-db4a-4c0d-9d50-c69871134b0f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:39.537664 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-27c8831e-db4a-4c0d-9d50-c69871134b0f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:39.538394 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-27c8831e-db4a-4c0d-9d50-c69871134b0f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:39.611622 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c418e274-b7e8-48fe-a5f7-f25916aa019c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:39.612540 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c418e274-b7e8-48fe-a5f7-f25916aa019c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:39.627186 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c418e274-b7e8-48fe-a5f7-f25916aa019c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:39.627633 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c418e274-b7e8-48fe-a5f7-f25916aa019c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:39.628424 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c418e274-b7e8-48fe-a5f7-f25916aa019c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:39.628849 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c418e274-b7e8-48fe-a5f7-f25916aa019c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:39.695185 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c418e274-b7e8-48fe-a5f7-f25916aa019c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.087198 Jan 28 02:05:39.704397 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 334/686] 10.222.0.77 () {60 vars in 1342 bytes} [Fri Jan 28 02:05:39 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:05:39.836301 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ca693c31-bcaf-4901-9409-2da85c041a72 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:39.838243 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ca693c31-bcaf-4901-9409-2da85c041a72 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:39.877974 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ca693c31-bcaf-4901-9409-2da85c041a72 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:39.878828 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ca693c31-bcaf-4901-9409-2da85c041a72 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:39.880127 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ca693c31-bcaf-4901-9409-2da85c041a72 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:39.880740 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ca693c31-bcaf-4901-9409-2da85c041a72 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:39.949356 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ca693c31-bcaf-4901-9409-2da85c041a72 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:05:40.143499 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ca693c31-bcaf-4901-9409-2da85c041a72 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "DELETE /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 204 len: 0 microversion: 2.20 time: 0.317891 Jan 28 02:05:40.145160 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 335/687] 10.222.0.77 () {60 vars in 1279 bytes} [Fri Jan 28 02:05:39 2022] DELETE /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:05:40.155047 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d2964214-6d2d-49c2-8026-f865024e7a0c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:40.155659 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d2964214-6d2d-49c2-8026-f865024e7a0c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:40.163679 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d2964214-6d2d-49c2-8026-f865024e7a0c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:40.164425 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d2964214-6d2d-49c2-8026-f865024e7a0c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:40.165480 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d2964214-6d2d-49c2-8026-f865024e7a0c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:40.166120 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d2964214-6d2d-49c2-8026-f865024e7a0c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:40.198357 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-27c8831e-db4a-4c0d-9d50-c69871134b0f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:40.207963 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-27c8831e-db4a-4c0d-9d50-c69871134b0f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.696096 Jan 28 02:05:40.209326 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 353/688] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:39 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:40.413785 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d2964214-6d2d-49c2-8026-f865024e7a0c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:40.424754 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d2964214-6d2d-49c2-8026-f865024e7a0c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:40.426472 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d2964214-6d2d-49c2-8026-f865024e7a0c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:40.427804 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d2964214-6d2d-49c2-8026-f865024e7a0c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 0.277790 Jan 28 02:05:40.428835 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 336/689] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:40 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:41.228223 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-9932d518-146f-4ff7-a8e6-d0e6ceb47ba6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:41.229447 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-9932d518-146f-4ff7-a8e6-d0e6ceb47ba6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:41.239508 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9932d518-146f-4ff7-a8e6-d0e6ceb47ba6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:41.240139 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9932d518-146f-4ff7-a8e6-d0e6ceb47ba6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:41.241142 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9932d518-146f-4ff7-a8e6-d0e6ceb47ba6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:41.242138 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9932d518-146f-4ff7-a8e6-d0e6ceb47ba6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:41.448254 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c58d0064-2e11-4245-9771-e5627eef6515 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:41.450037 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c58d0064-2e11-4245-9771-e5627eef6515 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:41.469180 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c58d0064-2e11-4245-9771-e5627eef6515 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:41.469829 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c58d0064-2e11-4245-9771-e5627eef6515 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:41.473245 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c58d0064-2e11-4245-9771-e5627eef6515 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:41.475245 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c58d0064-2e11-4245-9771-e5627eef6515 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:41.535714 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-9932d518-146f-4ff7-a8e6-d0e6ceb47ba6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:41.548352 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-9932d518-146f-4ff7-a8e6-d0e6ceb47ba6 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1757 microversion: 2.1 time: 0.324182 Jan 28 02:05:41.549530 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 354/690] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:41 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1757 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:41.870675 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c58d0064-2e11-4245-9771-e5627eef6515 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:41.880552 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c58d0064-2e11-4245-9771-e5627eef6515 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:41.882459 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c58d0064-2e11-4245-9771-e5627eef6515 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:41.884261 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c58d0064-2e11-4245-9771-e5627eef6515 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1722 microversion: 2.20 time: 0.441059 Jan 28 02:05:41.885607 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 337/691] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:41 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1722 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:42.567407 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e1ccce84-e80e-4a56-b92f-5b929b7329ec tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:42.568014 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e1ccce84-e80e-4a56-b92f-5b929b7329ec tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:42.576946 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e1ccce84-e80e-4a56-b92f-5b929b7329ec tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:42.577396 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e1ccce84-e80e-4a56-b92f-5b929b7329ec tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:42.578767 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e1ccce84-e80e-4a56-b92f-5b929b7329ec tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:42.583963 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e1ccce84-e80e-4a56-b92f-5b929b7329ec tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:42.775778 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e1ccce84-e80e-4a56-b92f-5b929b7329ec tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:42.786574 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e1ccce84-e80e-4a56-b92f-5b929b7329ec tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1760 microversion: 2.1 time: 0.223757 Jan 28 02:05:42.788373 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 355/692] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:42 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1760 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:42.903238 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9058defb-cbff-4826-b74a-2cc3bb3e13e1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:42.904560 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9058defb-cbff-4826-b74a-2cc3bb3e13e1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:42.911460 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9058defb-cbff-4826-b74a-2cc3bb3e13e1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:42.912740 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9058defb-cbff-4826-b74a-2cc3bb3e13e1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:42.913707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9058defb-cbff-4826-b74a-2cc3bb3e13e1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:42.914257 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9058defb-cbff-4826-b74a-2cc3bb3e13e1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:43.010258 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9058defb-cbff-4826-b74a-2cc3bb3e13e1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:43.019663 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9058defb-cbff-4826-b74a-2cc3bb3e13e1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:43.021832 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9058defb-cbff-4826-b74a-2cc3bb3e13e1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:43.023270 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9058defb-cbff-4826-b74a-2cc3bb3e13e1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 200 len: 1655 microversion: 2.20 time: 0.124105 Jan 28 02:05:43.024400 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 338/693] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:42 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 1655 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:43.220463 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-280dadd4-42d0-4498-b64f-87c191cbf0e4 req-654fe8d4-6068-4a5f-acd1-8c205821fb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d048580-813a-43b7-ae1a-e0b1a9c8c234", "name": "network-vif-deleted", "tag": "1c3eebfc-cf3d-4a86-8be4-2f39da195acf"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:43.227776 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:05:43.227776 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:05:43.240804 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-280dadd4-42d0-4498-b64f-87c191cbf0e4 req-654fe8d4-6068-4a5f-acd1-8c205821fb2e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:43.242056 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-280dadd4-42d0-4498-b64f-87c191cbf0e4 req-654fe8d4-6068-4a5f-acd1-8c205821fb2e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:43.280673 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-280dadd4-42d0-4498-b64f-87c191cbf0e4 req-654fe8d4-6068-4a5f-acd1-8c205821fb2e service nova] Creating event network-vif-deleted:1c3eebfc-cf3d-4a86-8be4-2f39da195acf for instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234 on hv-cinder-82497 Jan 28 02:05:43.293328 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-280dadd4-42d0-4498-b64f-87c191cbf0e4 req-654fe8d4-6068-4a5f-acd1-8c205821fb2e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084207 Jan 28 02:05:43.295398 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 356/694] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:05:44.047134 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5fa8c0c0-516e-4566-b022-108ff4c15f08 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:44.047899 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5fa8c0c0-516e-4566-b022-108ff4c15f08 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:44.060503 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5fa8c0c0-516e-4566-b022-108ff4c15f08 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:44.062325 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5fa8c0c0-516e-4566-b022-108ff4c15f08 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:44.065274 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5fa8c0c0-516e-4566-b022-108ff4c15f08 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:44.067419 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5fa8c0c0-516e-4566-b022-108ff4c15f08 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:44.103676 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-5fa8c0c0-516e-4566-b022-108ff4c15f08 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] HTTP exception thrown: Instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234 could not be found. Jan 28 02:05:44.104547 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5fa8c0c0-516e-4566-b022-108ff4c15f08 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Returning 404 to user: Instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:05:44.106150 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5fa8c0c0-516e-4566-b022-108ff4c15f08 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 404 len: 111 microversion: 2.20 time: 0.067253 Jan 28 02:05:44.108243 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 339/695] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:44 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:05:44.126006 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ea8f073e-1794-4693-b4ea-63599403608a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '.version_select at 0x7f08d661daf0>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:44.194896 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ea8f073e-1794-4693-b4ea-63599403608a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-656139416" status: 204 len: 0 microversion: 2.20 time: 0.077323 Jan 28 02:05:44.202189 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 357/696] 10.222.0.77 () {60 vars in 1258 bytes} [Fri Jan 28 02:05:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-656139416 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:05:45.580844 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c4f0c25e-4c79-4a4b-8cdb-93859d852fdc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'create', calling method: .version_select at 0x7f08d5e25dc0>, body: {"keypair": {"name": "tempest-keypair-485075928"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:45.636139 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-c4f0c25e-4c79-4a4b-8cdb-93859d852fdc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Getting quotas for project 578fc5bd64da4dcdbff2e317361168ec. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:05:45.650547 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-c4f0c25e-4c79-4a4b-8cdb-93859d852fdc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Getting quotas for user 264a23388dc64b269325ae52eb4130de and project 578fc5bd64da4dcdbff2e317361168ec. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:05:46.075855 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-c4f0c25e-4c79-4a4b-8cdb-93859d852fdc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Getting quotas for project 578fc5bd64da4dcdbff2e317361168ec. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:05:46.083279 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-c4f0c25e-4c79-4a4b-8cdb-93859d852fdc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Getting quotas for user 264a23388dc64b269325ae52eb4130de and project 578fc5bd64da4dcdbff2e317361168ec. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:05:46.101701 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c4f0c25e-4c79-4a4b-8cdb-93859d852fdc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.524570 Jan 28 02:05:46.103445 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 340/697] 10.222.0.77 () {62 vars in 1198 bytes} [Fri Jan 28 02:05:45 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 528 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:05:48.075623 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1584458309", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34615009-fca5-44cc-84b3-0752c6a7e426"}], "security_groups": [{"name": "tempest-securitygroup--1942144154"}], "key_name": "tempest-keypair-485075928", "user_data": "}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:48.261604 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.network.neutron [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] validate_networks() for [('34615009-fca5-44cc-84b3-0752c6a7e426', None, None, None, None, None)] {{(pid=115761) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:05:48.838498 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Flavor limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:05:48.838920 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Image limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:05:48.839434 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Flavor pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:05:48.840187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Image pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:05:48.840603 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:05:48.850735 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:48.851407 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:48.852379 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:48.852979 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:48.877597 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Getting quotas for project 578fc5bd64da4dcdbff2e317361168ec. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:05:48.891866 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Getting quotas for user 264a23388dc64b269325ae52eb4130de and project 578fc5bd64da4dcdbff2e317361168ec. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:05:48.909737 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Going to run 1 instances... {{(pid=115761) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:05:48.912302 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:05:48.989515 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d415aab9-dca1-4026-ab68-585c2a6e4492 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.920252 Jan 28 02:05:48.990957 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 358/698] 10.222.0.77 () {62 vars in 1187 bytes} [Fri Jan 28 02:05:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 02:05:49.002110 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9e132c62-55f9-4507-b42e-ce9d9a516710 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:49.003515 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9e132c62-55f9-4507-b42e-ce9d9a516710 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:49.150544 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9e132c62-55f9-4507-b42e-ce9d9a516710 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:49.159098 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9e132c62-55f9-4507-b42e-ce9d9a516710 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:49.160614 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9e132c62-55f9-4507-b42e-ce9d9a516710 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:49.161764 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9e132c62-55f9-4507-b42e-ce9d9a516710 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1281 microversion: 2.20 time: 0.165281 Jan 28 02:05:49.162330 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 341/699] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:48 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1281 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:50.181360 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1f6bc3ca-8b0e-48be-9e1f-0d91f8014ede tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:50.182683 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1f6bc3ca-8b0e-48be-9e1f-0d91f8014ede tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:50.192037 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1f6bc3ca-8b0e-48be-9e1f-0d91f8014ede tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:50.192834 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1f6bc3ca-8b0e-48be-9e1f-0d91f8014ede tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:50.193890 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1f6bc3ca-8b0e-48be-9e1f-0d91f8014ede tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:50.194486 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1f6bc3ca-8b0e-48be-9e1f-0d91f8014ede tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:50.264931 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1f6bc3ca-8b0e-48be-9e1f-0d91f8014ede tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:50.275925 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1f6bc3ca-8b0e-48be-9e1f-0d91f8014ede tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:50.277455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1f6bc3ca-8b0e-48be-9e1f-0d91f8014ede tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:50.279501 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1f6bc3ca-8b0e-48be-9e1f-0d91f8014ede tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1333 microversion: 2.20 time: 0.103534 Jan 28 02:05:50.280737 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 359/700] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:50 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:50.740698 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-696204f0-e9d0-4989-abf9-87c2ffca0764 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Action: 'create', calling method: .version_select at 0x7f08d5dc4430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1346427623"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:50.776521 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-696204f0-e9d0-4989-abf9-87c2ffca0764 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Getting quotas for project d88874e13aa04221b933b43cb2350ad2. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:05:50.785487 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-696204f0-e9d0-4989-abf9-87c2ffca0764 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Getting quotas for user 44ac16b6ba0c415da52972cda26bbd2d and project d88874e13aa04221b933b43cb2350ad2. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:05:51.077769 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-696204f0-e9d0-4989-abf9-87c2ffca0764 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Getting quotas for project d88874e13aa04221b933b43cb2350ad2. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:05:51.085120 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-696204f0-e9d0-4989-abf9-87c2ffca0764 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Getting quotas for user 44ac16b6ba0c415da52972cda26bbd2d and project d88874e13aa04221b933b43cb2350ad2. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:05:51.104574 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-696204f0-e9d0-4989-abf9-87c2ffca0764 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.779674 Jan 28 02:05:51.105164 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 342/701] 10.222.0.77 () {60 vars in 1157 bytes} [Fri Jan 28 02:05:50 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:51.303316 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-47674024-9285-4cd2-bf64-6b77431ff820 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:51.304368 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-47674024-9285-4cd2-bf64-6b77431ff820 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:51.326353 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-47674024-9285-4cd2-bf64-6b77431ff820 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:51.327790 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-47674024-9285-4cd2-bf64-6b77431ff820 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:51.329241 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-47674024-9285-4cd2-bf64-6b77431ff820 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:51.331493 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-47674024-9285-4cd2-bf64-6b77431ff820 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:51.590880 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-47674024-9285-4cd2-bf64-6b77431ff820 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:51.602187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-47674024-9285-4cd2-bf64-6b77431ff820 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:51.604560 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-47674024-9285-4cd2-bf64-6b77431ff820 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:51.606527 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-47674024-9285-4cd2-bf64-6b77431ff820 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1407 microversion: 2.20 time: 0.309129 Jan 28 02:05:51.607452 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 360/702] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:51 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:52.624959 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1370ae88-999b-4a12-9396-1b6bd2c9a940 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:52.625624 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1370ae88-999b-4a12-9396-1b6bd2c9a940 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:52.633428 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1370ae88-999b-4a12-9396-1b6bd2c9a940 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:52.634770 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1370ae88-999b-4a12-9396-1b6bd2c9a940 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:52.636939 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1370ae88-999b-4a12-9396-1b6bd2c9a940 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:52.642824 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1370ae88-999b-4a12-9396-1b6bd2c9a940 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:52.705110 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-b035254b-4a6c-49fe-ba64-a46f13ab6e7d req-5c9ae5af-174c-4168-915b-386c240c9d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cce5b81-d0cd-4833-a177-47b577b84152", "tag": "e15e44d6-18a5-424f-9579-7820746bc72a"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:52.706835 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:05:52.706835 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:05:52.726729 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-b035254b-4a6c-49fe-ba64-a46f13ab6e7d req-5c9ae5af-174c-4168-915b-386c240c9d24 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:52.727187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-b035254b-4a6c-49fe-ba64-a46f13ab6e7d req-5c9ae5af-174c-4168-915b-386c240c9d24 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:52.753951 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-b035254b-4a6c-49fe-ba64-a46f13ab6e7d req-5c9ae5af-174c-4168-915b-386c240c9d24 service nova] Creating event network-changed:e15e44d6-18a5-424f-9579-7820746bc72a for instance 7cce5b81-d0cd-4833-a177-47b577b84152 on hv-cinder-82497 Jan 28 02:05:52.760431 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-b035254b-4a6c-49fe-ba64-a46f13ab6e7d req-5c9ae5af-174c-4168-915b-386c240c9d24 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060664 Jan 28 02:05:52.761439 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 361/703] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:52.878621 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-1370ae88-999b-4a12-9396-1b6bd2c9a940 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:52.886858 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-1370ae88-999b-4a12-9396-1b6bd2c9a940 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:52.888348 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-1370ae88-999b-4a12-9396-1b6bd2c9a940 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:52.891242 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1370ae88-999b-4a12-9396-1b6bd2c9a940 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1407 microversion: 2.20 time: 0.269711 Jan 28 02:05:52.909216 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 343/704] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:52 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:53.916686 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-9e0b433b-eebd-4c68-94b6-aea463123332 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:53.917566 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-9e0b433b-eebd-4c68-94b6-aea463123332 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:53.925851 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9e0b433b-eebd-4c68-94b6-aea463123332 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:53.926555 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9e0b433b-eebd-4c68-94b6-aea463123332 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:53.927560 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9e0b433b-eebd-4c68-94b6-aea463123332 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:53.928193 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9e0b433b-eebd-4c68-94b6-aea463123332 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:54.087742 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-9e0b433b-eebd-4c68-94b6-aea463123332 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:54.096733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-9e0b433b-eebd-4c68-94b6-aea463123332 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:54.098598 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-9e0b433b-eebd-4c68-94b6-aea463123332 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:54.100255 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-9e0b433b-eebd-4c68-94b6-aea463123332 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1407 microversion: 2.20 time: 0.187581 Jan 28 02:05:54.100976 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 362/705] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:53 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:55.119412 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7dc95e33-43e7-44e1-b86d-f8c05a1aa8f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:55.120091 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7dc95e33-43e7-44e1-b86d-f8c05a1aa8f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:55.128622 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7dc95e33-43e7-44e1-b86d-f8c05a1aa8f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:55.129055 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7dc95e33-43e7-44e1-b86d-f8c05a1aa8f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:55.129921 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7dc95e33-43e7-44e1-b86d-f8c05a1aa8f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:55.130294 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7dc95e33-43e7-44e1-b86d-f8c05a1aa8f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:55.351388 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7dc95e33-43e7-44e1-b86d-f8c05a1aa8f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:55.363366 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7dc95e33-43e7-44e1-b86d-f8c05a1aa8f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:55.364875 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7dc95e33-43e7-44e1-b86d-f8c05a1aa8f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:55.366552 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7dc95e33-43e7-44e1-b86d-f8c05a1aa8f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1407 microversion: 2.20 time: 0.251464 Jan 28 02:05:55.368066 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 344/706] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:55 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:56.389147 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8333a129-9cf9-4a09-bbc2-809b5f2f8ac2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:56.389959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8333a129-9cf9-4a09-bbc2-809b5f2f8ac2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:56.395910 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8333a129-9cf9-4a09-bbc2-809b5f2f8ac2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:56.396335 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8333a129-9cf9-4a09-bbc2-809b5f2f8ac2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:56.397128 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8333a129-9cf9-4a09-bbc2-809b5f2f8ac2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:56.397559 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8333a129-9cf9-4a09-bbc2-809b5f2f8ac2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:56.530386 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8333a129-9cf9-4a09-bbc2-809b5f2f8ac2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:56.538793 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8333a129-9cf9-4a09-bbc2-809b5f2f8ac2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:56.541091 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8333a129-9cf9-4a09-bbc2-809b5f2f8ac2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:56.542710 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8333a129-9cf9-4a09-bbc2-809b5f2f8ac2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1407 microversion: 2.20 time: 0.161896 Jan 28 02:05:56.543409 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 363/707] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:56 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:05:56.745398 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-97f568b1-b6c3-4674-8d65-fb8f14cec89b req-dd9ef99f-ec61-4934-97ac-4dd66b4efe7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5b81-d0cd-4833-a177-47b577b84152", "name": "network-vif-plugged", "status": "completed", "tag": "e15e44d6-18a5-424f-9579-7820746bc72a"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:56.747847 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:05:56.747847 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:05:56.755184 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-97f568b1-b6c3-4674-8d65-fb8f14cec89b req-dd9ef99f-ec61-4934-97ac-4dd66b4efe7e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:56.755622 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-97f568b1-b6c3-4674-8d65-fb8f14cec89b req-dd9ef99f-ec61-4934-97ac-4dd66b4efe7e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:56.768130 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-97f568b1-b6c3-4674-8d65-fb8f14cec89b req-dd9ef99f-ec61-4934-97ac-4dd66b4efe7e service nova] Creating event network-vif-plugged:e15e44d6-18a5-424f-9579-7820746bc72a for instance 7cce5b81-d0cd-4833-a177-47b577b84152 on hv-cinder-82497 Jan 28 02:05:56.773566 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-97f568b1-b6c3-4674-8d65-fb8f14cec89b req-dd9ef99f-ec61-4934-97ac-4dd66b4efe7e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031993 Jan 28 02:05:56.774384 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 345/708] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:57.562141 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-720d1bc9-d58e-4848-95a1-6bba40efceab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:57.563257 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-720d1bc9-d58e-4848-95a1-6bba40efceab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:57.569481 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-720d1bc9-d58e-4848-95a1-6bba40efceab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:57.569968 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-720d1bc9-d58e-4848-95a1-6bba40efceab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:57.570752 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-720d1bc9-d58e-4848-95a1-6bba40efceab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:57.571179 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-720d1bc9-d58e-4848-95a1-6bba40efceab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:57.707958 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-720d1bc9-d58e-4848-95a1-6bba40efceab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:57.716299 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-720d1bc9-d58e-4848-95a1-6bba40efceab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:57.717833 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-720d1bc9-d58e-4848-95a1-6bba40efceab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:57.719003 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-720d1bc9-d58e-4848-95a1-6bba40efceab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1407 microversion: 2.20 time: 0.160691 Jan 28 02:05:57.719566 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 364/709] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:57 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:58.736974 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9aa745bf-a98b-437b-ba79-ef61aa97e91f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:58.737788 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9aa745bf-a98b-437b-ba79-ef61aa97e91f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:58.744607 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9aa745bf-a98b-437b-ba79-ef61aa97e91f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:58.745057 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9aa745bf-a98b-437b-ba79-ef61aa97e91f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:58.745956 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9aa745bf-a98b-437b-ba79-ef61aa97e91f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:58.746393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9aa745bf-a98b-437b-ba79-ef61aa97e91f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:58.882155 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9aa745bf-a98b-437b-ba79-ef61aa97e91f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:58.891068 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9aa745bf-a98b-437b-ba79-ef61aa97e91f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:58.892554 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9aa745bf-a98b-437b-ba79-ef61aa97e91f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:58.893884 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9aa745bf-a98b-437b-ba79-ef61aa97e91f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1599 microversion: 2.20 time: 0.160979 Jan 28 02:05:58.894445 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 346/710] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:05:58 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:58.912153 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e22dc490-d597-4822-b2c9-eba292d9626c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:58.912803 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e22dc490-d597-4822-b2c9-eba292d9626c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:58.919076 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e22dc490-d597-4822-b2c9-eba292d9626c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:58.919521 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e22dc490-d597-4822-b2c9-eba292d9626c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:58.920353 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e22dc490-d597-4822-b2c9-eba292d9626c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:58.920792 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e22dc490-d597-4822-b2c9-eba292d9626c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:59.013630 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e22dc490-d597-4822-b2c9-eba292d9626c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105333 Jan 28 02:05:59.014245 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 365/711] 10.222.0.77 () {60 vars in 1315 bytes} [Fri Jan 28 02:05:58 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:06:00.300527 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-1b51deb9-a0d1-46bf-b497-a15e25244fc7 req-9b51c857-d5a4-42d4-afb6-7aee31b48a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cce5b81-d0cd-4833-a177-47b577b84152", "tag": "e15e44d6-18a5-424f-9579-7820746bc72a"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:00.302644 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-76c90b77-59a8-4c75-bfee-530085f2978b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:00.304004 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-76c90b77-59a8-4c75-bfee-530085f2978b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:00.305972 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:00.305972 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:06:00.310771 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-76c90b77-59a8-4c75-bfee-530085f2978b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:00.311303 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-76c90b77-59a8-4c75-bfee-530085f2978b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:00.312316 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-76c90b77-59a8-4c75-bfee-530085f2978b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:00.312817 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-76c90b77-59a8-4c75-bfee-530085f2978b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:00.313333 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-1b51deb9-a0d1-46bf-b497-a15e25244fc7 req-9b51c857-d5a4-42d4-afb6-7aee31b48a55 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:00.313810 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-1b51deb9-a0d1-46bf-b497-a15e25244fc7 req-9b51c857-d5a4-42d4-afb6-7aee31b48a55 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:00.325627 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-1b51deb9-a0d1-46bf-b497-a15e25244fc7 req-9b51c857-d5a4-42d4-afb6-7aee31b48a55 service nova] Creating event network-changed:e15e44d6-18a5-424f-9579-7820746bc72a for instance 7cce5b81-d0cd-4833-a177-47b577b84152 on hv-cinder-82497 Jan 28 02:06:00.331725 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-1b51deb9-a0d1-46bf-b497-a15e25244fc7 req-9b51c857-d5a4-42d4-afb6-7aee31b48a55 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035219 Jan 28 02:06:00.332551 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 366/712] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:00.437009 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-76c90b77-59a8-4c75-bfee-530085f2978b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 14 microversion: 2.20 time: 0.142833 Jan 28 02:06:00.438804 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 347/713] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:00 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:01.449009 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-87331e0a-9960-442a-a361-c7fdced17f67 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:01.450048 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-87331e0a-9960-442a-a361-c7fdced17f67 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:01.456654 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-87331e0a-9960-442a-a361-c7fdced17f67 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:01.457123 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-87331e0a-9960-442a-a361-c7fdced17f67 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:01.457945 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-87331e0a-9960-442a-a361-c7fdced17f67 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:01.458372 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-87331e0a-9960-442a-a361-c7fdced17f67 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:01.550096 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-87331e0a-9960-442a-a361-c7fdced17f67 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 14 microversion: 2.20 time: 0.104667 Jan 28 02:06:01.553807 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 367/714] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:01 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:02.563850 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7009187a-c148-4b2f-8733-1c9f05a4d5c8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:02.564850 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7009187a-c148-4b2f-8733-1c9f05a4d5c8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:02.571995 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7009187a-c148-4b2f-8733-1c9f05a4d5c8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:02.572445 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7009187a-c148-4b2f-8733-1c9f05a4d5c8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:02.573229 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7009187a-c148-4b2f-8733-1c9f05a4d5c8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:02.573664 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7009187a-c148-4b2f-8733-1c9f05a4d5c8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:02.659997 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7009187a-c148-4b2f-8733-1c9f05a4d5c8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 14 microversion: 2.20 time: 0.101106 Jan 28 02:06:02.660633 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 348/715] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:02 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:03.673011 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-08fc9b67-2743-481f-92b0-82278c5c71af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:03.674048 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-08fc9b67-2743-481f-92b0-82278c5c71af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:03.681433 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-08fc9b67-2743-481f-92b0-82278c5c71af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:03.681972 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-08fc9b67-2743-481f-92b0-82278c5c71af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:03.682759 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-08fc9b67-2743-481f-92b0-82278c5c71af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:03.683338 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-08fc9b67-2743-481f-92b0-82278c5c71af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:03.772286 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-08fc9b67-2743-481f-92b0-82278c5c71af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 14 microversion: 2.20 time: 0.103060 Jan 28 02:06:03.772772 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 368/716] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:03 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:04.783681 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e03e1489-e7aa-4ebb-96c4-d110912d421c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:04.784710 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e03e1489-e7aa-4ebb-96c4-d110912d421c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:04.791576 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e03e1489-e7aa-4ebb-96c4-d110912d421c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:04.792022 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e03e1489-e7aa-4ebb-96c4-d110912d421c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:04.792803 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e03e1489-e7aa-4ebb-96c4-d110912d421c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:04.793235 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e03e1489-e7aa-4ebb-96c4-d110912d421c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:04.885459 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-e03e1489-e7aa-4ebb-96c4-d110912d421c tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 14 microversion: 2.20 time: 0.106479 Jan 28 02:06:04.888905 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 349/717] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:04 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:05.899710 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-55a4465b-74bf-4eee-8683-a2e233e333f0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:05.900615 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-55a4465b-74bf-4eee-8683-a2e233e333f0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:05.908175 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-55a4465b-74bf-4eee-8683-a2e233e333f0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:05.908616 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-55a4465b-74bf-4eee-8683-a2e233e333f0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:05.909656 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-55a4465b-74bf-4eee-8683-a2e233e333f0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:05.910122 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-55a4465b-74bf-4eee-8683-a2e233e333f0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:06.002212 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-55a4465b-74bf-4eee-8683-a2e233e333f0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 14 microversion: 2.20 time: 0.106491 Jan 28 02:06:06.002848 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 369/718] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:05 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:06.804041 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-701900861", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "networks": [{"uuid": "15196eb6-806a-4b15-875b-747d0ec1afab"}]}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:06.855698 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.network.neutron [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] validate_networks() for [('15196eb6-806a-4b15-875b-747d0ec1afab', None, None, None, None, None)] {{(pid=115760) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:06:07.013498 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d48078de-5984-47cd-876d-d20630398cd6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:07.015440 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d48078de-5984-47cd-876d-d20630398cd6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:07.021672 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d48078de-5984-47cd-876d-d20630398cd6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:07.022613 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d48078de-5984-47cd-876d-d20630398cd6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:07.023579 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d48078de-5984-47cd-876d-d20630398cd6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:07.024012 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d48078de-5984-47cd-876d-d20630398cd6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:07.112799 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d48078de-5984-47cd-876d-d20630398cd6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 14 microversion: 2.20 time: 0.103628 Jan 28 02:06:07.113543 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 370/719] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:07 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:07.216143 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Flavor limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:06:07.216554 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Image limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:06:07.217016 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Flavor pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:06:07.217538 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Image pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:06:07.217996 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:06:07.230740 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:07.231264 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:07.232063 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:07.232492 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:07.261293 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Getting quotas for project 2f9f6ec5f21a4775a393a6e55e34b617. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:07.265528 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Getting quotas for user 0ca9e2035efb4434939b300e1fbe6e2b and project 2f9f6ec5f21a4775a393a6e55e34b617. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:07.277921 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Going to run 1 instances... {{(pid=115760) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:06:07.280496 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:06:07.338021 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ec366877-ed50-4281-84a0-f71c93c2a11a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537854 Jan 28 02:06:07.338676 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 350/720] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:06:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:06:07.349445 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bd811c27-b196-427a-abaf-e7562063ea0d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:07.350153 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bd811c27-b196-427a-abaf-e7562063ea0d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:07.402896 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-bd811c27-b196-427a-abaf-e7562063ea0d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:07.409777 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-bd811c27-b196-427a-abaf-e7562063ea0d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 200 len: 1218 microversion: 2.1 time: 0.064368 Jan 28 02:06:07.410355 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 371/721] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:07 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:08.124322 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-be5fd069-0977-4969-a4c8-e1f4ef9092cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:08.125809 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-be5fd069-0977-4969-a4c8-e1f4ef9092cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:08.132476 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-be5fd069-0977-4969-a4c8-e1f4ef9092cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:08.132915 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-be5fd069-0977-4969-a4c8-e1f4ef9092cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:08.133690 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-be5fd069-0977-4969-a4c8-e1f4ef9092cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:08.134146 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-be5fd069-0977-4969-a4c8-e1f4ef9092cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:08.238042 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-be5fd069-0977-4969-a4c8-e1f4ef9092cf tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 14 microversion: 2.20 time: 0.117257 Jan 28 02:06:08.238723 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 351/722] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:08 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:08.427898 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-26486ef9-7f1f-4224-b284-15a408037a27 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:08.428844 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-26486ef9-7f1f-4224-b284-15a408037a27 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:08.436630 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-26486ef9-7f1f-4224-b284-15a408037a27 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:08.437070 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-26486ef9-7f1f-4224-b284-15a408037a27 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:08.438801 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-26486ef9-7f1f-4224-b284-15a408037a27 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:08.439444 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-26486ef9-7f1f-4224-b284-15a408037a27 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:08.503705 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-26486ef9-7f1f-4224-b284-15a408037a27 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:08.511437 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-26486ef9-7f1f-4224-b284-15a408037a27 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 200 len: 1288 microversion: 2.1 time: 0.087743 Jan 28 02:06:08.514609 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 372/723] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:08 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:09.249017 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-142a2727-4f9f-41b1-8dd1-54962f1bd04e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:09.250860 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-142a2727-4f9f-41b1-8dd1-54962f1bd04e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:09.257929 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-142a2727-4f9f-41b1-8dd1-54962f1bd04e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:09.258524 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-142a2727-4f9f-41b1-8dd1-54962f1bd04e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:09.259423 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-142a2727-4f9f-41b1-8dd1-54962f1bd04e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:09.259953 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-142a2727-4f9f-41b1-8dd1-54962f1bd04e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:09.303956 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1086418362", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1346427623", "security_groups": [{"name": "tempest-secgroup-smoke-43440463"}], "block_device_mapping_v2": [{"uuid": "7d5d59e7-b5e2-420d-98e2-bd0e2bf81049", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7946a91b-c87f-479e-b41f-92c9cd8d4828"}]}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:09.355735 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-142a2727-4f9f-41b1-8dd1-54962f1bd04e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 14 microversion: 2.20 time: 0.110589 Jan 28 02:06:09.359025 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 352/724] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:09 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:09.414298 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.network.neutron [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] validate_networks() for [('7946a91b-c87f-479e-b41f-92c9cd8d4828', None, None, None, None, None)] {{(pid=115761) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:06:09.530674 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-03bf39b8-2994-4117-b55e-46da700ad4aa tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:09.531488 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-03bf39b8-2994-4117-b55e-46da700ad4aa tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:09.538948 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-03bf39b8-2994-4117-b55e-46da700ad4aa tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:09.539991 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-03bf39b8-2994-4117-b55e-46da700ad4aa tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:09.540648 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-03bf39b8-2994-4117-b55e-46da700ad4aa tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:09.541186 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-03bf39b8-2994-4117-b55e-46da700ad4aa tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:09.745793 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-03bf39b8-2994-4117-b55e-46da700ad4aa tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:09.756659 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-03bf39b8-2994-4117-b55e-46da700ad4aa tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 200 len: 1318 microversion: 2.1 time: 0.230792 Jan 28 02:06:09.758383 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 353/725] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:09 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:09.865247 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Flavor limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:06:09.865795 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Image limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:06:09.866172 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Flavor pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:06:09.866585 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Image pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:06:09.867007 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:06:09.879468 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:09.879921 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:09.880734 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:09.881290 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:09.899094 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Getting quotas for project d88874e13aa04221b933b43cb2350ad2. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:09.902968 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Getting quotas for user 44ac16b6ba0c415da52972cda26bbd2d and project d88874e13aa04221b933b43cb2350ad2. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:09.949119 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-42b7d6d3-d47b-4ac1-8faf-1688cadd10d5 req-d5037b26-e327-4323-adcf-0d05933bda7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aeab016-de44-4bfb-af1e-8d7282e55502", "tag": "2f49cc6d-5280-48fc-82bb-ac87442b2506"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:09.950977 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:09.950977 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:06:09.959291 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-42b7d6d3-d47b-4ac1-8faf-1688cadd10d5 req-d5037b26-e327-4323-adcf-0d05933bda7d service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:09.959736 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-42b7d6d3-d47b-4ac1-8faf-1688cadd10d5 req-d5037b26-e327-4323-adcf-0d05933bda7d service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:09.971676 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-42b7d6d3-d47b-4ac1-8faf-1688cadd10d5 req-d5037b26-e327-4323-adcf-0d05933bda7d service nova] Creating event network-changed:2f49cc6d-5280-48fc-82bb-ac87442b2506 for instance 9aeab016-de44-4bfb-af1e-8d7282e55502 on hv-cinder-82497 Jan 28 02:06:09.976945 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Going to run 1 instances... {{(pid=115761) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:06:09.977403 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-42b7d6d3-d47b-4ac1-8faf-1688cadd10d5 req-d5037b26-e327-4323-adcf-0d05933bda7d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041700 Jan 28 02:06:09.978017 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 354/726] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:09.979524 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d5d59e7-b5e2-420d-98e2-bd0e2bf81049',volume_size=None,volume_type=None)] {{(pid=115761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:06:10.116164 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-5bc6cf79-84f3-471d-b2df-b14fdce8e907 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.815711 Jan 28 02:06:10.122104 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 373/727] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:06:09 2022] POST /compute/v2.1/servers => generated 404 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 02:06:10.131465 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6a01b4c1-9281-49fc-862b-4db24c28de76 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:10.132270 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6a01b4c1-9281-49fc-862b-4db24c28de76 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:10.206476 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6a01b4c1-9281-49fc-862b-4db24c28de76 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:10.213334 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6a01b4c1-9281-49fc-862b-4db24c28de76 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1095 microversion: 2.1 time: 0.089696 Jan 28 02:06:10.214504 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 355/728] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:10 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1095 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:10.366829 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-fab91084-9db4-4288-98b5-a75009873a0a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:10.368075 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-fab91084-9db4-4288-98b5-a75009873a0a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:10.374245 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fab91084-9db4-4288-98b5-a75009873a0a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:10.374870 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fab91084-9db4-4288-98b5-a75009873a0a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:10.375886 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fab91084-9db4-4288-98b5-a75009873a0a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:10.376379 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fab91084-9db4-4288-98b5-a75009873a0a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:10.529141 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-fab91084-9db4-4288-98b5-a75009873a0a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 14 microversion: 2.20 time: 0.165872 Jan 28 02:06:10.533640 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 374/729] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:10 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:10.776698 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-fab4e8b9-56f7-4537-bf7d-cf738966b61c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:10.777314 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-fab4e8b9-56f7-4537-bf7d-cf738966b61c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:10.787618 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fab4e8b9-56f7-4537-bf7d-cf738966b61c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:10.788066 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fab4e8b9-56f7-4537-bf7d-cf738966b61c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:10.789244 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fab4e8b9-56f7-4537-bf7d-cf738966b61c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:10.789686 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fab4e8b9-56f7-4537-bf7d-cf738966b61c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:10.935433 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-fab4e8b9-56f7-4537-bf7d-cf738966b61c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:10.943707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-fab4e8b9-56f7-4537-bf7d-cf738966b61c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 200 len: 1318 microversion: 2.1 time: 0.171445 Jan 28 02:06:10.944284 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 356/730] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:10 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:11.232563 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ab611f45-3562-4c82-ac93-edea750c33e2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:11.233265 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ab611f45-3562-4c82-ac93-edea750c33e2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:11.240306 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ab611f45-3562-4c82-ac93-edea750c33e2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:11.240752 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ab611f45-3562-4c82-ac93-edea750c33e2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:11.241551 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ab611f45-3562-4c82-ac93-edea750c33e2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:11.242014 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ab611f45-3562-4c82-ac93-edea750c33e2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:11.324421 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ab611f45-3562-4c82-ac93-edea750c33e2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:11.332863 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ab611f45-3562-4c82-ac93-edea750c33e2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1201 microversion: 2.1 time: 0.104599 Jan 28 02:06:11.333434 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 375/731] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:11 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1201 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:11.540692 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2d7ae3ef-e836-4b9a-8459-43bdacf866b9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:11.541612 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2d7ae3ef-e836-4b9a-8459-43bdacf866b9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:11.551262 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2d7ae3ef-e836-4b9a-8459-43bdacf866b9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:11.551722 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2d7ae3ef-e836-4b9a-8459-43bdacf866b9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:11.552507 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2d7ae3ef-e836-4b9a-8459-43bdacf866b9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:11.552931 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2d7ae3ef-e836-4b9a-8459-43bdacf866b9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:11.635606 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2d7ae3ef-e836-4b9a-8459-43bdacf866b9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 14 microversion: 2.20 time: 0.098463 Jan 28 02:06:11.638910 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 357/732] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:11 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:11.961830 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-96b1cb31-6384-43b0-acf2-2928cce9e994 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:11.962744 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-96b1cb31-6384-43b0-acf2-2928cce9e994 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:11.971988 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-96b1cb31-6384-43b0-acf2-2928cce9e994 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:11.972780 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-96b1cb31-6384-43b0-acf2-2928cce9e994 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:11.973945 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-96b1cb31-6384-43b0-acf2-2928cce9e994 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:11.974636 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-96b1cb31-6384-43b0-acf2-2928cce9e994 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:12.118229 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-96b1cb31-6384-43b0-acf2-2928cce9e994 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:12.125892 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-96b1cb31-6384-43b0-acf2-2928cce9e994 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 200 len: 1318 microversion: 2.1 time: 0.168968 Jan 28 02:06:12.126453 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 376/733] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:11 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:12.349964 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6765ff7a-8845-45eb-aa89-10f68cbbfff2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:12.350662 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6765ff7a-8845-45eb-aa89-10f68cbbfff2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:12.357341 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6765ff7a-8845-45eb-aa89-10f68cbbfff2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:12.358075 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6765ff7a-8845-45eb-aa89-10f68cbbfff2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:12.358874 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6765ff7a-8845-45eb-aa89-10f68cbbfff2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:12.359777 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6765ff7a-8845-45eb-aa89-10f68cbbfff2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:12.516396 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6765ff7a-8845-45eb-aa89-10f68cbbfff2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:12.525908 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6765ff7a-8845-45eb-aa89-10f68cbbfff2 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1265 microversion: 2.1 time: 0.179844 Jan 28 02:06:12.526957 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 358/734] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:12 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:12.643744 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-86072e9f-4f11-4fbc-8d12-663f74733b3a req-4b3fb93d-09c5-4df1-aa2b-07e683ec866a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f81333-d5d4-4278-90ed-540420db8271", "tag": "4143fbb4-bf61-4984-a2ff-d28966a621d6"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:12.646309 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:12.646309 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:06:12.647839 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f69c9380-c309-4ea1-883b-f872c18369f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:12.650060 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f69c9380-c309-4ea1-883b-f872c18369f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:12.660899 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f69c9380-c309-4ea1-883b-f872c18369f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:12.661495 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f69c9380-c309-4ea1-883b-f872c18369f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:12.662322 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f69c9380-c309-4ea1-883b-f872c18369f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:12.662763 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f69c9380-c309-4ea1-883b-f872c18369f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:12.676475 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-86072e9f-4f11-4fbc-8d12-663f74733b3a req-4b3fb93d-09c5-4df1-aa2b-07e683ec866a service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:12.677431 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-86072e9f-4f11-4fbc-8d12-663f74733b3a req-4b3fb93d-09c5-4df1-aa2b-07e683ec866a service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:12.692243 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-86072e9f-4f11-4fbc-8d12-663f74733b3a req-4b3fb93d-09c5-4df1-aa2b-07e683ec866a service nova] Creating event network-changed:4143fbb4-bf61-4984-a2ff-d28966a621d6 for instance 96f81333-d5d4-4278-90ed-540420db8271 on hv-cinder-82497 Jan 28 02:06:12.699295 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-86072e9f-4f11-4fbc-8d12-663f74733b3a req-4b3fb93d-09c5-4df1-aa2b-07e683ec866a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063101 Jan 28 02:06:12.701251 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 377/735] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:12.796462 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f69c9380-c309-4ea1-883b-f872c18369f8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 6451 microversion: 2.20 time: 0.152217 Jan 28 02:06:12.798894 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 359/736] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:12 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 6451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:06:13.143933 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8f3924a3-b198-46ae-90ac-9cd81e7c5abd tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:13.144898 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8f3924a3-b198-46ae-90ac-9cd81e7c5abd tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:13.150779 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8f3924a3-b198-46ae-90ac-9cd81e7c5abd tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:13.151229 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8f3924a3-b198-46ae-90ac-9cd81e7c5abd tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:13.152015 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8f3924a3-b198-46ae-90ac-9cd81e7c5abd tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:13.152449 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8f3924a3-b198-46ae-90ac-9cd81e7c5abd tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:13.284899 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8f3924a3-b198-46ae-90ac-9cd81e7c5abd tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:13.292690 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8f3924a3-b198-46ae-90ac-9cd81e7c5abd tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 200 len: 1318 microversion: 2.1 time: 0.152788 Jan 28 02:06:13.293601 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 378/737] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:13 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:13.543793 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-fb6eb4db-7d38-4bf9-ab17-422dbd5bb9ba tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:13.544492 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-fb6eb4db-7d38-4bf9-ab17-422dbd5bb9ba tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:13.551462 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fb6eb4db-7d38-4bf9-ab17-422dbd5bb9ba tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:13.551910 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fb6eb4db-7d38-4bf9-ab17-422dbd5bb9ba tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:13.552711 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fb6eb4db-7d38-4bf9-ab17-422dbd5bb9ba tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:13.553148 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fb6eb4db-7d38-4bf9-ab17-422dbd5bb9ba tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:13.679365 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-fb6eb4db-7d38-4bf9-ab17-422dbd5bb9ba tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:13.687024 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-fb6eb4db-7d38-4bf9-ab17-422dbd5bb9ba tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1265 microversion: 2.1 time: 0.147264 Jan 28 02:06:13.687597 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 360/738] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:13 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:13.808664 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2b4d6bc0-2ce8-44c2-9766-adba95decc48 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:13.809580 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-2b4d6bc0-2ce8-44c2-9766-adba95decc48 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:13.816353 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b4d6bc0-2ce8-44c2-9766-adba95decc48 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:13.817062 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b4d6bc0-2ce8-44c2-9766-adba95decc48 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:13.817871 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b4d6bc0-2ce8-44c2-9766-adba95decc48 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:13.818308 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2b4d6bc0-2ce8-44c2-9766-adba95decc48 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:13.917699 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2b4d6bc0-2ce8-44c2-9766-adba95decc48 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 14250 microversion: 2.20 time: 0.112503 Jan 28 02:06:13.918383 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 379/739] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:13 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 14250 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:14.310779 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-da6665d4-9b71-422f-b1fd-7c6c2bee330d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:14.311379 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-da6665d4-9b71-422f-b1fd-7c6c2bee330d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:14.318112 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-da6665d4-9b71-422f-b1fd-7c6c2bee330d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:14.318548 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-da6665d4-9b71-422f-b1fd-7c6c2bee330d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:14.319303 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-da6665d4-9b71-422f-b1fd-7c6c2bee330d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:14.319725 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-da6665d4-9b71-422f-b1fd-7c6c2bee330d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:14.445791 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-da6665d4-9b71-422f-b1fd-7c6c2bee330d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:14.453251 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-da6665d4-9b71-422f-b1fd-7c6c2bee330d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 200 len: 1318 microversion: 2.1 time: 0.146116 Jan 28 02:06:14.453826 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 361/740] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:14 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:14.703818 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f4bccf29-8f42-4811-9033-f1c903079158 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:14.704602 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f4bccf29-8f42-4811-9033-f1c903079158 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:14.711132 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f4bccf29-8f42-4811-9033-f1c903079158 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:14.711657 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f4bccf29-8f42-4811-9033-f1c903079158 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:14.712438 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f4bccf29-8f42-4811-9033-f1c903079158 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:14.712870 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f4bccf29-8f42-4811-9033-f1c903079158 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:14.777724 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-13d64879-141c-4481-b366-b307c4175ccc req-1e067882-9faf-479f-9e10-e78f9845e060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aeab016-de44-4bfb-af1e-8d7282e55502", "name": "network-vif-plugged", "status": "completed", "tag": "2f49cc6d-5280-48fc-82bb-ac87442b2506"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:14.779415 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:14.779415 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:06:14.787843 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-13d64879-141c-4481-b366-b307c4175ccc req-1e067882-9faf-479f-9e10-e78f9845e060 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:14.788366 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-13d64879-141c-4481-b366-b307c4175ccc req-1e067882-9faf-479f-9e10-e78f9845e060 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:14.803646 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-13d64879-141c-4481-b366-b307c4175ccc req-1e067882-9faf-479f-9e10-e78f9845e060 service nova] Creating event network-vif-plugged:2f49cc6d-5280-48fc-82bb-ac87442b2506 for instance 9aeab016-de44-4bfb-af1e-8d7282e55502 on hv-cinder-82497 Jan 28 02:06:14.808513 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-13d64879-141c-4481-b366-b307c4175ccc req-1e067882-9faf-479f-9e10-e78f9845e060 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035055 Jan 28 02:06:14.809226 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 362/741] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:14.841616 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f4bccf29-8f42-4811-9033-f1c903079158 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:14.850266 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f4bccf29-8f42-4811-9033-f1c903079158 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1265 microversion: 2.1 time: 0.150546 Jan 28 02:06:14.860793 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 380/742] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:14 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:14.930033 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f05096c7-56dd-4d48-8840-4a57412eb17f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:14.931035 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f05096c7-56dd-4d48-8840-4a57412eb17f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:14.938020 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f05096c7-56dd-4d48-8840-4a57412eb17f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:14.938465 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f05096c7-56dd-4d48-8840-4a57412eb17f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:14.939244 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f05096c7-56dd-4d48-8840-4a57412eb17f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:14.939674 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f05096c7-56dd-4d48-8840-4a57412eb17f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:15.044818 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f05096c7-56dd-4d48-8840-4a57412eb17f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 18561 microversion: 2.20 time: 0.118934 Jan 28 02:06:15.045459 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 363/743] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:14 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 18561 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:15.470022 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a4428748-229b-4752-bbd4-48396c59d574 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:15.470659 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a4428748-229b-4752-bbd4-48396c59d574 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:15.476491 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a4428748-229b-4752-bbd4-48396c59d574 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:15.476934 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a4428748-229b-4752-bbd4-48396c59d574 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:15.477696 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a4428748-229b-4752-bbd4-48396c59d574 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:15.478159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a4428748-229b-4752-bbd4-48396c59d574 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:15.604840 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a4428748-229b-4752-bbd4-48396c59d574 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:15.614485 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a4428748-229b-4752-bbd4-48396c59d574 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 200 len: 1318 microversion: 2.1 time: 0.148014 Jan 28 02:06:15.615066 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 381/744] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:15 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:15.867924 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-46bde760-99bf-407e-b737-c7891adf2690 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:15.868573 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-46bde760-99bf-407e-b737-c7891adf2690 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:15.875829 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-46bde760-99bf-407e-b737-c7891adf2690 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:15.876279 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-46bde760-99bf-407e-b737-c7891adf2690 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:15.877064 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-46bde760-99bf-407e-b737-c7891adf2690 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:15.877494 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-46bde760-99bf-407e-b737-c7891adf2690 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:16.056396 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-36eb489c-8041-4a72-a438-b753211bdb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:16.057306 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-36eb489c-8041-4a72-a438-b753211bdb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:16.064425 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-36eb489c-8041-4a72-a438-b753211bdb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:16.064869 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-36eb489c-8041-4a72-a438-b753211bdb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:16.065650 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-36eb489c-8041-4a72-a438-b753211bdb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:16.066117 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-36eb489c-8041-4a72-a438-b753211bdb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:16.121844 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-46bde760-99bf-407e-b737-c7891adf2690 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:16.130322 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-46bde760-99bf-407e-b737-c7891adf2690 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1265 microversion: 2.1 time: 0.266577 Jan 28 02:06:16.130881 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 364/745] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:15 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:16.196490 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-36eb489c-8041-4a72-a438-b753211bdb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 19342 microversion: 2.20 time: 0.143556 Jan 28 02:06:16.197144 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 382/746] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:16 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 19342 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:06:16.630908 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-585bb776-0af3-43ae-a452-225f796a3e1e tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:16.631427 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-585bb776-0af3-43ae-a452-225f796a3e1e tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:16.637148 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-585bb776-0af3-43ae-a452-225f796a3e1e tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:16.637599 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-585bb776-0af3-43ae-a452-225f796a3e1e tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:16.638418 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-585bb776-0af3-43ae-a452-225f796a3e1e tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:16.638851 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-585bb776-0af3-43ae-a452-225f796a3e1e tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:16.759729 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-585bb776-0af3-43ae-a452-225f796a3e1e tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:16.767738 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-585bb776-0af3-43ae-a452-225f796a3e1e tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 200 len: 1508 microversion: 2.1 time: 0.140589 Jan 28 02:06:16.768402 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 365/747] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:16 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 1508 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:17.148049 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4036e16b-3abd-4109-b9c6-f6a7219460ea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:17.148739 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4036e16b-3abd-4109-b9c6-f6a7219460ea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:17.155839 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4036e16b-3abd-4109-b9c6-f6a7219460ea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:17.156046 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4036e16b-3abd-4109-b9c6-f6a7219460ea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:17.157081 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4036e16b-3abd-4109-b9c6-f6a7219460ea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:17.157533 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4036e16b-3abd-4109-b9c6-f6a7219460ea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:17.209230 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4f801ac8-7d9c-4a7e-983a-935ec6d4f967 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:17.211012 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4f801ac8-7d9c-4a7e-983a-935ec6d4f967 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:17.217859 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4f801ac8-7d9c-4a7e-983a-935ec6d4f967 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:17.218310 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4f801ac8-7d9c-4a7e-983a-935ec6d4f967 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:17.219116 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4f801ac8-7d9c-4a7e-983a-935ec6d4f967 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:17.219546 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4f801ac8-7d9c-4a7e-983a-935ec6d4f967 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:17.295189 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4036e16b-3abd-4109-b9c6-f6a7219460ea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:17.303225 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4036e16b-3abd-4109-b9c6-f6a7219460ea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1265 microversion: 2.1 time: 0.159469 Jan 28 02:06:17.303855 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 383/748] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:17 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:17.348115 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4f801ac8-7d9c-4a7e-983a-935ec6d4f967 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 21972 microversion: 2.20 time: 0.142534 Jan 28 02:06:17.349259 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 366/749] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:17 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 21972 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:18.321219 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f9e96ece-d159-45ed-86f8-a4674947bc76 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:18.321845 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f9e96ece-d159-45ed-86f8-a4674947bc76 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:18.328898 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f9e96ece-d159-45ed-86f8-a4674947bc76 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:18.329472 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f9e96ece-d159-45ed-86f8-a4674947bc76 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:18.330214 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f9e96ece-d159-45ed-86f8-a4674947bc76 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:18.330637 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f9e96ece-d159-45ed-86f8-a4674947bc76 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:18.360529 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-10c54ff9-4890-4527-ae41-9fc96102d781 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:18.361511 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-10c54ff9-4890-4527-ae41-9fc96102d781 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:18.368462 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-10c54ff9-4890-4527-ae41-9fc96102d781 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:18.368907 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-10c54ff9-4890-4527-ae41-9fc96102d781 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:18.369670 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-10c54ff9-4890-4527-ae41-9fc96102d781 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:18.370123 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-10c54ff9-4890-4527-ae41-9fc96102d781 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:18.469206 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f9e96ece-d159-45ed-86f8-a4674947bc76 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:18.477497 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f9e96ece-d159-45ed-86f8-a4674947bc76 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1265 microversion: 2.1 time: 0.160031 Jan 28 02:06:18.478109 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 384/750] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:18 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:18.496174 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-10c54ff9-4890-4527-ae41-9fc96102d781 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 23232 microversion: 2.20 time: 0.139438 Jan 28 02:06:18.496850 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 367/751] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:18 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 23232 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:06:19.497631 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-814de3e5-4a37-4806-97dc-af3c3b599c25 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:19.498283 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-814de3e5-4a37-4806-97dc-af3c3b599c25 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:19.506954 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-814de3e5-4a37-4806-97dc-af3c3b599c25 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:19.507682 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-814de3e5-4a37-4806-97dc-af3c3b599c25 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:19.509305 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-814de3e5-4a37-4806-97dc-af3c3b599c25 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:19.509472 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-849d4636-c1b5-4642-b970-b96d9fb47f59 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:19.510157 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-814de3e5-4a37-4806-97dc-af3c3b599c25 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:19.510473 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-849d4636-c1b5-4642-b970-b96d9fb47f59 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:19.519448 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-849d4636-c1b5-4642-b970-b96d9fb47f59 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:19.519894 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-849d4636-c1b5-4642-b970-b96d9fb47f59 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:19.520697 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-849d4636-c1b5-4642-b970-b96d9fb47f59 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:19.521126 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-849d4636-c1b5-4642-b970-b96d9fb47f59 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:19.641976 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-849d4636-c1b5-4642-b970-b96d9fb47f59 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 23996 microversion: 2.20 time: 0.135534 Jan 28 02:06:19.649348 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 368/752] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:19 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 23996 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:19.722008 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-814de3e5-4a37-4806-97dc-af3c3b599c25 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:19.729685 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-814de3e5-4a37-4806-97dc-af3c3b599c25 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1265 microversion: 2.1 time: 0.236360 Jan 28 02:06:19.730318 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 385/753] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:19 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:20.656271 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9163d651-f7dd-4906-97fe-7e1b2e4a6c58 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:20.657228 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9163d651-f7dd-4906-97fe-7e1b2e4a6c58 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:20.664009 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9163d651-f7dd-4906-97fe-7e1b2e4a6c58 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:20.664452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9163d651-f7dd-4906-97fe-7e1b2e4a6c58 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:20.665228 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9163d651-f7dd-4906-97fe-7e1b2e4a6c58 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:20.665651 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9163d651-f7dd-4906-97fe-7e1b2e4a6c58 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:20.746022 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1f062716-adf4-4fb0-bb2a-8bc3c3bbecad tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:20.746622 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1f062716-adf4-4fb0-bb2a-8bc3c3bbecad tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:20.752880 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1f062716-adf4-4fb0-bb2a-8bc3c3bbecad tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:20.753321 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1f062716-adf4-4fb0-bb2a-8bc3c3bbecad tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:20.754289 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1f062716-adf4-4fb0-bb2a-8bc3c3bbecad tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:20.754726 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1f062716-adf4-4fb0-bb2a-8bc3c3bbecad tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:20.770024 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9163d651-f7dd-4906-97fe-7e1b2e4a6c58 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 25519 microversion: 2.20 time: 0.118030 Jan 28 02:06:20.773926 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 369/754] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:20 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 25519 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:20.886598 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1f062716-adf4-4fb0-bb2a-8bc3c3bbecad tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:20.894025 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1f062716-adf4-4fb0-bb2a-8bc3c3bbecad tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1265 microversion: 2.1 time: 0.151573 Jan 28 02:06:20.894602 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 386/755] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:20 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:21.782785 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d397bfab-7f59-4a00-9c12-8a6dd510ad35 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:21.783989 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d397bfab-7f59-4a00-9c12-8a6dd510ad35 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:21.792105 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d397bfab-7f59-4a00-9c12-8a6dd510ad35 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:21.792549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d397bfab-7f59-4a00-9c12-8a6dd510ad35 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:21.793331 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d397bfab-7f59-4a00-9c12-8a6dd510ad35 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:21.793779 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d397bfab-7f59-4a00-9c12-8a6dd510ad35 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:21.910782 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a9f8cccf-83f5-4d52-8a31-356246f082dc tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:21.911389 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a9f8cccf-83f5-4d52-8a31-356246f082dc tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:21.913151 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d397bfab-7f59-4a00-9c12-8a6dd510ad35 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 26489 microversion: 2.20 time: 0.134807 Jan 28 02:06:21.914291 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 370/756] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:21 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 26489 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:21.918240 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a9f8cccf-83f5-4d52-8a31-356246f082dc tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:21.918699 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a9f8cccf-83f5-4d52-8a31-356246f082dc tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:21.919524 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a9f8cccf-83f5-4d52-8a31-356246f082dc tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:21.919997 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a9f8cccf-83f5-4d52-8a31-356246f082dc tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:22.051880 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a9f8cccf-83f5-4d52-8a31-356246f082dc tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:22.059492 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a9f8cccf-83f5-4d52-8a31-356246f082dc tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1265 microversion: 2.1 time: 0.153061 Jan 28 02:06:22.060071 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 387/757] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:21 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:22.580150 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6c625cdd-271b-4fcc-876f-81e003ccaf6f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-94748571"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:22.580765 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6c625cdd-271b-4fcc-876f-81e003ccaf6f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:22.587452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6c625cdd-271b-4fcc-876f-81e003ccaf6f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:22.587885 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6c625cdd-271b-4fcc-876f-81e003ccaf6f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:22.588653 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6c625cdd-271b-4fcc-876f-81e003ccaf6f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:22.589074 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6c625cdd-271b-4fcc-876f-81e003ccaf6f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:22.715855 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.network.security_group_api [None req-6c625cdd-271b-4fcc-876f-81e003ccaf6f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Removing security group ea1dd302-bd0a-4977-82e4-29786b62dcd1 from port df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1 Jan 28 02:06:22.877819 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-296082f2-30b8-4c6b-8e2e-5f38c4f34773 req-c97c8099-9a5c-465e-8e20-3fc47f7c196f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f81333-d5d4-4278-90ed-540420db8271", "name": "network-vif-plugged", "status": "completed", "tag": "4143fbb4-bf61-4984-a2ff-d28966a621d6"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:22.879875 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:22.879875 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:06:22.887235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-296082f2-30b8-4c6b-8e2e-5f38c4f34773 req-c97c8099-9a5c-465e-8e20-3fc47f7c196f service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:22.887675 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-296082f2-30b8-4c6b-8e2e-5f38c4f34773 req-c97c8099-9a5c-465e-8e20-3fc47f7c196f service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:22.902145 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-296082f2-30b8-4c6b-8e2e-5f38c4f34773 req-c97c8099-9a5c-465e-8e20-3fc47f7c196f service nova] Creating event network-vif-plugged:4143fbb4-bf61-4984-a2ff-d28966a621d6 for instance 96f81333-d5d4-4278-90ed-540420db8271 on hv-cinder-82497 Jan 28 02:06:22.909211 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-296082f2-30b8-4c6b-8e2e-5f38c4f34773 req-c97c8099-9a5c-465e-8e20-3fc47f7c196f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035421 Jan 28 02:06:22.909211 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 388/758] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:22.926140 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f331fe71-e98b-421a-ab23-368e27a05ab4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:22.927300 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f331fe71-e98b-421a-ab23-368e27a05ab4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:22.934120 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f331fe71-e98b-421a-ab23-368e27a05ab4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:22.934563 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f331fe71-e98b-421a-ab23-368e27a05ab4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:22.935438 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f331fe71-e98b-421a-ab23-368e27a05ab4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:22.937995 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f331fe71-e98b-421a-ab23-368e27a05ab4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:23.058875 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f331fe71-e98b-421a-ab23-368e27a05ab4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 27312 microversion: 2.20 time: 0.136741 Jan 28 02:06:23.060443 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 389/759] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:22 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 27312 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:23.093412 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6fbf8116-6acc-48c3-92f8-12efd2fd0c45 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:23.099321 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6c625cdd-271b-4fcc-876f-81e003ccaf6f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "POST /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/action" status: 202 len: 0 microversion: 2.1 time: 0.522581 Jan 28 02:06:23.099858 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6fbf8116-6acc-48c3-92f8-12efd2fd0c45 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:23.102517 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 371/760] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:06:22 2022] POST /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:23.116016 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-8ab1b3cf-6a4b-4f91-8518-a01917d2b36f req-6979cc24-ed8c-474c-8652-3fd8760f895d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99e0d03-1fe8-4dd7-9c5d-e67a633ab920", "tag": "df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:23.119376 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:23.119376 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:06:23.128694 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-8ab1b3cf-6a4b-4f91-8518-a01917d2b36f req-6979cc24-ed8c-474c-8652-3fd8760f895d service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:23.129407 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-8ab1b3cf-6a4b-4f91-8518-a01917d2b36f req-6979cc24-ed8c-474c-8652-3fd8760f895d service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:23.154799 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-8ab1b3cf-6a4b-4f91-8518-a01917d2b36f req-6979cc24-ed8c-474c-8652-3fd8760f895d service nova] Creating event network-changed:df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1 for instance b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 on hv-cinder-82497 Jan 28 02:06:23.156083 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6fbf8116-6acc-48c3-92f8-12efd2fd0c45 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:23.156879 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6fbf8116-6acc-48c3-92f8-12efd2fd0c45 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:23.158627 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6fbf8116-6acc-48c3-92f8-12efd2fd0c45 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:23.159415 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6fbf8116-6acc-48c3-92f8-12efd2fd0c45 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:23.162160 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-8ab1b3cf-6a4b-4f91-8518-a01917d2b36f req-6979cc24-ed8c-474c-8652-3fd8760f895d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049242 Jan 28 02:06:23.166972 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 372/761] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:23.394905 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6fbf8116-6acc-48c3-92f8-12efd2fd0c45 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:23.405049 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6fbf8116-6acc-48c3-92f8-12efd2fd0c45 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1265 microversion: 2.1 time: 0.332062 Jan 28 02:06:23.406755 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 390/762] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:23 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:24.071557 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-eb9c9a19-995b-409f-8f8b-2d059725751b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:24.072524 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-eb9c9a19-995b-409f-8f8b-2d059725751b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:24.080316 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eb9c9a19-995b-409f-8f8b-2d059725751b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:24.080765 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eb9c9a19-995b-409f-8f8b-2d059725751b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:24.081563 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eb9c9a19-995b-409f-8f8b-2d059725751b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:24.082026 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eb9c9a19-995b-409f-8f8b-2d059725751b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:24.200879 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-eb9c9a19-995b-409f-8f8b-2d059725751b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 27665 microversion: 2.20 time: 0.133604 Jan 28 02:06:24.208024 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 373/763] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:24 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 27665 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:24.423005 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d0763fdc-70f0-44f1-a4e7-1673caa48efb tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:24.423607 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d0763fdc-70f0-44f1-a4e7-1673caa48efb tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:24.429570 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d0763fdc-70f0-44f1-a4e7-1673caa48efb tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:24.430108 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d0763fdc-70f0-44f1-a4e7-1673caa48efb tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:24.430874 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d0763fdc-70f0-44f1-a4e7-1673caa48efb tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:24.431298 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d0763fdc-70f0-44f1-a4e7-1673caa48efb tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:24.660793 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d0763fdc-70f0-44f1-a4e7-1673caa48efb tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:24.668126 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d0763fdc-70f0-44f1-a4e7-1673caa48efb tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1265 microversion: 2.1 time: 0.249422 Jan 28 02:06:24.668725 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 391/764] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:24 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:24.818848 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-54c2d37b-db1f-4a38-9d86-423151e74d09 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:24.819570 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-54c2d37b-db1f-4a38-9d86-423151e74d09 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:24.826612 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-54c2d37b-db1f-4a38-9d86-423151e74d09 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:24.827060 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-54c2d37b-db1f-4a38-9d86-423151e74d09 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:24.827909 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-54c2d37b-db1f-4a38-9d86-423151e74d09 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:24.828339 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-54c2d37b-db1f-4a38-9d86-423151e74d09 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:24.924960 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.objects.instance [None req-54c2d37b-db1f-4a38-9d86-423151e74d09 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lazy-loading 'services' on Instance uuid b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 {{(pid=115760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:06:25.003016 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-54c2d37b-db1f-4a38-9d86-423151e74d09 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "DELETE /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/os-volume_attachments/63b4b152-990e-4ba4-9160-ef101ac8e724" status: 202 len: 0 microversion: 2.1 time: 0.188423 Jan 28 02:06:25.003682 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 374/765] 10.222.0.77 () {58 vars in 1415 bytes} [Fri Jan 28 02:06:24 2022] DELETE /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/os-volume_attachments/63b4b152-990e-4ba4-9160-ef101ac8e724 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:25.013136 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6c1f684a-d39d-4878-bca3-3db45eefc205 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:25.023064 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6c1f684a-d39d-4878-bca3-3db45eefc205 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:25.031273 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6c1f684a-d39d-4878-bca3-3db45eefc205 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.033594 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6c1f684a-d39d-4878-bca3-3db45eefc205 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.034839 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6c1f684a-d39d-4878-bca3-3db45eefc205 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.035357 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6c1f684a-d39d-4878-bca3-3db45eefc205 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.069814 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6c1f684a-d39d-4878-bca3-3db45eefc205 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061106 Jan 28 02:06:25.071101 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 392/766] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:06:25 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:25.179705 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-383bb1f4-b857-4020-9ce0-9dac00d9ce38 req-76287917-610e-48c4-a4e9-09271d0169e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99e0d03-1fe8-4dd7-9c5d-e67a633ab920", "tag": "df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:25.181228 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:25.181228 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:06:25.188494 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-383bb1f4-b857-4020-9ce0-9dac00d9ce38 req-76287917-610e-48c4-a4e9-09271d0169e6 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.188931 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-383bb1f4-b857-4020-9ce0-9dac00d9ce38 req-76287917-610e-48c4-a4e9-09271d0169e6 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.200157 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-383bb1f4-b857-4020-9ce0-9dac00d9ce38 req-76287917-610e-48c4-a4e9-09271d0169e6 service nova] Creating event network-changed:df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1 for instance b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 on hv-cinder-82497 Jan 28 02:06:25.205180 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-383bb1f4-b857-4020-9ce0-9dac00d9ce38 req-76287917-610e-48c4-a4e9-09271d0169e6 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029893 Jan 28 02:06:25.205841 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 375/767] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:25.216068 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-dd43661f-b29d-4cd0-ba29-27ba47da1c5f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:25.216068 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-dd43661f-b29d-4cd0-ba29-27ba47da1c5f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:25.223293 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dd43661f-b29d-4cd0-ba29-27ba47da1c5f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.223747 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dd43661f-b29d-4cd0-ba29-27ba47da1c5f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.224539 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dd43661f-b29d-4cd0-ba29-27ba47da1c5f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.224977 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dd43661f-b29d-4cd0-ba29-27ba47da1c5f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.362262 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-dd43661f-b29d-4cd0-ba29-27ba47da1c5f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 27834 microversion: 2.20 time: 0.151898 Jan 28 02:06:25.367404 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 393/768] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:25 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 27834 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:25.687015 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-25726dcc-edcc-4db9-bcf7-6f4235ca38e3 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:25.687790 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-25726dcc-edcc-4db9-bcf7-6f4235ca38e3 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:25.694575 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-25726dcc-edcc-4db9-bcf7-6f4235ca38e3 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.695117 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-25726dcc-edcc-4db9-bcf7-6f4235ca38e3 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.695975 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-25726dcc-edcc-4db9-bcf7-6f4235ca38e3 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.696597 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-25726dcc-edcc-4db9-bcf7-6f4235ca38e3 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.839675 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-25726dcc-edcc-4db9-bcf7-6f4235ca38e3 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:25.854010 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-25726dcc-edcc-4db9-bcf7-6f4235ca38e3 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1451 microversion: 2.1 time: 0.171302 Jan 28 02:06:25.854720 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 376/769] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:25 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:25.876592 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-035ec3a7-2928-4ff3-b281-03916bf99391 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:25.877404 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-035ec3a7-2928-4ff3-b281-03916bf99391 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:25.885412 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-035ec3a7-2928-4ff3-b281-03916bf99391 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.886428 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-035ec3a7-2928-4ff3-b281-03916bf99391 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.887680 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-035ec3a7-2928-4ff3-b281-03916bf99391 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.888178 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-035ec3a7-2928-4ff3-b281-03916bf99391 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:26.030667 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-035ec3a7-2928-4ff3-b281-03916bf99391 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:26.038791 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-035ec3a7-2928-4ff3-b281-03916bf99391 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1451 microversion: 2.1 time: 0.171760 Jan 28 02:06:26.039107 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 394/770] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:25 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:26.082047 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6be2519b-8e14-41dd-a3f5-db36c3ae7b62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:26.083078 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6be2519b-8e14-41dd-a3f5-db36c3ae7b62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:26.089510 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6be2519b-8e14-41dd-a3f5-db36c3ae7b62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:26.090018 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6be2519b-8e14-41dd-a3f5-db36c3ae7b62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:26.090795 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6be2519b-8e14-41dd-a3f5-db36c3ae7b62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:26.091237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6be2519b-8e14-41dd-a3f5-db36c3ae7b62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:26.122603 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6be2519b-8e14-41dd-a3f5-db36c3ae7b62 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044848 Jan 28 02:06:26.123497 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 377/771] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:06:26 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:26.374578 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5716ad93-40b1-4bac-b57a-dbb08376aeba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:26.376174 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-5716ad93-40b1-4bac-b57a-dbb08376aeba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:26.382686 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5716ad93-40b1-4bac-b57a-dbb08376aeba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:26.383128 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5716ad93-40b1-4bac-b57a-dbb08376aeba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:26.383923 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5716ad93-40b1-4bac-b57a-dbb08376aeba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:26.384374 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5716ad93-40b1-4bac-b57a-dbb08376aeba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:26.488982 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-5716ad93-40b1-4bac-b57a-dbb08376aeba tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 28212 microversion: 2.20 time: 0.118090 Jan 28 02:06:26.494119 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 395/772] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:26 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 28212 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:27.137987 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-acf29c50-9bff-40b4-ab49-1c5dd0af0263 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:27.139057 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-acf29c50-9bff-40b4-ab49-1c5dd0af0263 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:27.146119 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-acf29c50-9bff-40b4-ab49-1c5dd0af0263 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:27.146611 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-acf29c50-9bff-40b4-ab49-1c5dd0af0263 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:27.147393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-acf29c50-9bff-40b4-ab49-1c5dd0af0263 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:27.147817 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-acf29c50-9bff-40b4-ab49-1c5dd0af0263 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:27.180723 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-acf29c50-9bff-40b4-ab49-1c5dd0af0263 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048007 Jan 28 02:06:27.181283 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 378/773] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:06:27 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:06:27.194169 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f8f3be3f-53f2-4642-afe6-4a48adaf472f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:27.195698 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f8f3be3f-53f2-4642-afe6-4a48adaf472f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:27.203460 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f8f3be3f-53f2-4642-afe6-4a48adaf472f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:27.203914 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f8f3be3f-53f2-4642-afe6-4a48adaf472f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:27.204767 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f8f3be3f-53f2-4642-afe6-4a48adaf472f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:27.205298 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f8f3be3f-53f2-4642-afe6-4a48adaf472f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:27.298391 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-f8f3be3f-53f2-4642-afe6-4a48adaf472f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] HTTP exception thrown: Instance b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 is not attached to volume 63b4b152-990e-4ba4-9160-ef101ac8e724 Jan 28 02:06:27.299227 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f8f3be3f-53f2-4642-afe6-4a48adaf472f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Returning 404 to user: Instance b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 is not attached to volume 63b4b152-990e-4ba4-9160-ef101ac8e724 {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:27.300091 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f8f3be3f-53f2-4642-afe6-4a48adaf472f tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "DELETE /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/os-volume_attachments/63b4b152-990e-4ba4-9160-ef101ac8e724" status: 404 len: 154 microversion: 2.1 time: 0.112795 Jan 28 02:06:27.300661 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 396/774] 10.222.0.77 () {58 vars in 1415 bytes} [Fri Jan 28 02:06:27 2022] DELETE /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920/os-volume_attachments/63b4b152-990e-4ba4-9160-ef101ac8e724 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:27.502767 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2eba2d03-cf16-4fb0-b3c7-2d10a9c187ea tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:27.503790 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2eba2d03-cf16-4fb0-b3c7-2d10a9c187ea tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:27.510035 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2eba2d03-cf16-4fb0-b3c7-2d10a9c187ea tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:27.510586 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2eba2d03-cf16-4fb0-b3c7-2d10a9c187ea tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:27.511595 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2eba2d03-cf16-4fb0-b3c7-2d10a9c187ea tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:27.512020 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2eba2d03-cf16-4fb0-b3c7-2d10a9c187ea tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:27.609552 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2eba2d03-cf16-4fb0-b3c7-2d10a9c187ea tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 28212 microversion: 2.20 time: 0.110773 Jan 28 02:06:27.610363 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 379/775] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:27 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 28212 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:28.005887 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-f7c856f4-d608-435f-990e-816a2ec4a308 req-e67570fd-be7f-4449-89d9-f3dfcb44bfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f81333-d5d4-4278-90ed-540420db8271", "tag": "4143fbb4-bf61-4984-a2ff-d28966a621d6"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:28.008954 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:28.008954 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:06:28.020010 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-f7c856f4-d608-435f-990e-816a2ec4a308 req-e67570fd-be7f-4449-89d9-f3dfcb44bfe9 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:28.020459 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-f7c856f4-d608-435f-990e-816a2ec4a308 req-e67570fd-be7f-4449-89d9-f3dfcb44bfe9 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:28.033434 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-f7c856f4-d608-435f-990e-816a2ec4a308 req-e67570fd-be7f-4449-89d9-f3dfcb44bfe9 service nova] Creating event network-changed:4143fbb4-bf61-4984-a2ff-d28966a621d6 for instance 96f81333-d5d4-4278-90ed-540420db8271 on hv-cinder-82497 Jan 28 02:06:28.038460 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-f7c856f4-d608-435f-990e-816a2ec4a308 req-e67570fd-be7f-4449-89d9-f3dfcb44bfe9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036242 Jan 28 02:06:28.039055 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 397/776] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:28.463925 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ddcc8a42-f4e9-413a-874a-67138044765e tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:28.464495 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ddcc8a42-f4e9-413a-874a-67138044765e tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:28.473277 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ddcc8a42-f4e9-413a-874a-67138044765e tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:28.473809 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ddcc8a42-f4e9-413a-874a-67138044765e tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:28.474815 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ddcc8a42-f4e9-413a-874a-67138044765e tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:28.475604 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ddcc8a42-f4e9-413a-874a-67138044765e tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:28.502865 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ddcc8a42-f4e9-413a-874a-67138044765e tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:06:28.590221 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ddcc8a42-f4e9-413a-874a-67138044765e tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "DELETE /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 204 len: 0 microversion: 2.1 time: 0.130181 Jan 28 02:06:28.594176 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 380/777] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:06:28 2022] DELETE /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:06:28.604485 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f434cd6b-3699-4536-8928-e452bd86bebe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:28.605505 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f434cd6b-3699-4536-8928-e452bd86bebe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:28.613993 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f434cd6b-3699-4536-8928-e452bd86bebe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:28.614603 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f434cd6b-3699-4536-8928-e452bd86bebe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:28.615710 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f434cd6b-3699-4536-8928-e452bd86bebe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:28.616190 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f434cd6b-3699-4536-8928-e452bd86bebe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:28.624187 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-de83caac-c752-43f2-8b55-abfef273c899 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:28.625817 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-de83caac-c752-43f2-8b55-abfef273c899 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:28.632520 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-de83caac-c752-43f2-8b55-abfef273c899 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:28.633434 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-de83caac-c752-43f2-8b55-abfef273c899 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:28.634627 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-de83caac-c752-43f2-8b55-abfef273c899 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:28.635635 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-de83caac-c752-43f2-8b55-abfef273c899 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:28.749318 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-de83caac-c752-43f2-8b55-abfef273c899 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 28503 microversion: 2.20 time: 0.130497 Jan 28 02:06:28.749986 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 381/778] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:28 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 28503 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:28.776714 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f434cd6b-3699-4536-8928-e452bd86bebe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:28.786253 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f434cd6b-3699-4536-8928-e452bd86bebe tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1556 microversion: 2.1 time: 0.186152 Jan 28 02:06:28.786927 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 398/779] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:28 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1556 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:29.761990 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-eed4f728-63a1-4398-a6d0-fc312f2b2153 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:29.762985 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-eed4f728-63a1-4398-a6d0-fc312f2b2153 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:29.770546 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eed4f728-63a1-4398-a6d0-fc312f2b2153 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:29.770990 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eed4f728-63a1-4398-a6d0-fc312f2b2153 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:29.771792 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eed4f728-63a1-4398-a6d0-fc312f2b2153 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:29.772220 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eed4f728-63a1-4398-a6d0-fc312f2b2153 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:29.805025 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a70244a4-f2a1-437e-8a45-32dec9400a68 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:29.805639 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a70244a4-f2a1-437e-8a45-32dec9400a68 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:29.812105 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a70244a4-f2a1-437e-8a45-32dec9400a68 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:29.812544 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a70244a4-f2a1-437e-8a45-32dec9400a68 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:29.813305 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a70244a4-f2a1-437e-8a45-32dec9400a68 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:29.813770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a70244a4-f2a1-437e-8a45-32dec9400a68 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:29.888325 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-eed4f728-63a1-4398-a6d0-fc312f2b2153 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 28519 microversion: 2.20 time: 0.130235 Jan 28 02:06:29.892298 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 382/780] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:29 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 28519 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:29.954875 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a70244a4-f2a1-437e-8a45-32dec9400a68 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:29.962287 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a70244a4-f2a1-437e-8a45-32dec9400a68 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1556 microversion: 2.1 time: 0.161050 Jan 28 02:06:29.962846 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 399/781] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:29 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:30.980558 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-eeae51e1-71fa-4e4c-a719-06259e9970bb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:30.981240 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-eeae51e1-71fa-4e4c-a719-06259e9970bb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:30.987503 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-eeae51e1-71fa-4e4c-a719-06259e9970bb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:30.987957 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-eeae51e1-71fa-4e4c-a719-06259e9970bb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:30.988737 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-eeae51e1-71fa-4e4c-a719-06259e9970bb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:30.989177 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-eeae51e1-71fa-4e4c-a719-06259e9970bb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:31.024659 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-90fd05b7-ede5-4c9f-a792-4aa33ac3d081 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:31.025976 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-90fd05b7-ede5-4c9f-a792-4aa33ac3d081 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:31.034031 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-90fd05b7-ede5-4c9f-a792-4aa33ac3d081 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:31.034573 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-90fd05b7-ede5-4c9f-a792-4aa33ac3d081 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:31.035469 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-90fd05b7-ede5-4c9f-a792-4aa33ac3d081 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:31.035948 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-90fd05b7-ede5-4c9f-a792-4aa33ac3d081 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:31.133301 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-90fd05b7-ede5-4c9f-a792-4aa33ac3d081 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 28671 microversion: 2.20 time: 0.236338 Jan 28 02:06:31.136986 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 383/782] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:30 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 28671 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:31.137161 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-eeae51e1-71fa-4e4c-a719-06259e9970bb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abe1b4b11304db7965ce3e6d9c56c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f948307a28a46c882d15550cc527d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:31.144884 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-eeae51e1-71fa-4e4c-a719-06259e9970bb tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 200 len: 1556 microversion: 2.1 time: 0.167885 Jan 28 02:06:31.145470 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 400/783] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:30 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:31.509122 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-852c7729-167f-421c-9419-4c81afaa1591 req-e91c9434-11b1-4b66-8710-b3e996240966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99e0d03-1fe8-4dd7-9c5d-e67a633ab920", "name": "network-vif-deleted", "tag": "df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:31.510914 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:31.510914 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:06:31.520194 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-852c7729-167f-421c-9419-4c81afaa1591 req-e91c9434-11b1-4b66-8710-b3e996240966 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:31.520630 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-852c7729-167f-421c-9419-4c81afaa1591 req-e91c9434-11b1-4b66-8710-b3e996240966 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:31.534015 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-852c7729-167f-421c-9419-4c81afaa1591 req-e91c9434-11b1-4b66-8710-b3e996240966 service nova] Creating event network-vif-deleted:df1c8d4f-63d5-47e0-b6f4-2bd6680bd3b1 for instance b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 on hv-cinder-82497 Jan 28 02:06:31.539021 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-852c7729-167f-421c-9419-4c81afaa1591 req-e91c9434-11b1-4b66-8710-b3e996240966 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033881 Jan 28 02:06:31.539619 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 384/784] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:32.146625 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-372704b8-7412-4b4f-a0e5-35a8f255b89a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:32.147661 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-372704b8-7412-4b4f-a0e5-35a8f255b89a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:32.154815 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-372704b8-7412-4b4f-a0e5-35a8f255b89a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:32.155258 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-372704b8-7412-4b4f-a0e5-35a8f255b89a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:32.156041 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-372704b8-7412-4b4f-a0e5-35a8f255b89a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:32.156916 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-372704b8-7412-4b4f-a0e5-35a8f255b89a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:32.161987 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2c24f969-317c-4f6b-9b0d-36cec26856b1 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:32.163202 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2c24f969-317c-4f6b-9b0d-36cec26856b1 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] [instance: b99e0d03-1fe8-4dd7-9c5d-e67a633ab920] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:32.170975 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2c24f969-317c-4f6b-9b0d-36cec26856b1 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:32.171416 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2c24f969-317c-4f6b-9b0d-36cec26856b1 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:32.172201 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2c24f969-317c-4f6b-9b0d-36cec26856b1 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:32.172635 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2c24f969-317c-4f6b-9b0d-36cec26856b1 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:32.188531 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-2c24f969-317c-4f6b-9b0d-36cec26856b1 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] HTTP exception thrown: Instance b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 could not be found. Jan 28 02:06:32.189185 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2c24f969-317c-4f6b-9b0d-36cec26856b1 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Returning 404 to user: Instance b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:32.190228 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2c24f969-317c-4f6b-9b0d-36cec26856b1 tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920" status: 404 len: 111 microversion: 2.1 time: 0.032425 Jan 28 02:06:32.190841 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 385/785] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:32 2022] GET /compute/v2.1/servers/b99e0d03-1fe8-4dd7-9c5d-e67a633ab920 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:32.201817 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-66a2b1d9-4490-49b9-aed4-c89c316162da tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] Calling method '.version_select at 0x7f08d5decb80>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:32.220937 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-66a2b1d9-4490-49b9-aed4-c89c316162da tempest-TestMinimumBasicScenario-476935786 tempest-TestMinimumBasicScenario-476935786-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1922191641" status: 202 len: 0 microversion: 2.1 time: 0.024054 Jan 28 02:06:32.221506 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 386/786] 10.222.0.77 () {58 vars in 1271 bytes} [Fri Jan 28 02:06:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1922191641 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:32.257142 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-372704b8-7412-4b4f-a0e5-35a8f255b89a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 28671 microversion: 2.20 time: 0.115097 Jan 28 02:06:32.259773 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 401/787] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:32 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 28671 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:33.274910 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-0cd3dc53-a57e-4e9c-ad50-5f1e6432bfdb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:33.277176 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-0cd3dc53-a57e-4e9c-ad50-5f1e6432bfdb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:33.292068 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0cd3dc53-a57e-4e9c-ad50-5f1e6432bfdb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:33.292537 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0cd3dc53-a57e-4e9c-ad50-5f1e6432bfdb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:33.293335 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0cd3dc53-a57e-4e9c-ad50-5f1e6432bfdb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:33.293799 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0cd3dc53-a57e-4e9c-ad50-5f1e6432bfdb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:33.400645 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-0cd3dc53-a57e-4e9c-ad50-5f1e6432bfdb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 28671 microversion: 2.20 time: 0.132145 Jan 28 02:06:33.401351 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 387/788] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:33 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 28671 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:34.142166 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-953709ea-1522-4537-a3fc-51f99d7f6c01 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b1e75a1-32e9-4cf5-894d-07ce31c84f6c", "device": "/dev/sdb"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:34.143838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-953709ea-1522-4537-a3fc-51f99d7f6c01 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:34.150761 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-953709ea-1522-4537-a3fc-51f99d7f6c01 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.151303 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-953709ea-1522-4537-a3fc-51f99d7f6c01 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.152142 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-953709ea-1522-4537-a3fc-51f99d7f6c01 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.152515 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-953709ea-1522-4537-a3fc-51f99d7f6c01 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.413665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-69dda950-4dc0-46b2-88b2-4ffb82ce9a9e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:34.415322 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-69dda950-4dc0-46b2-88b2-4ffb82ce9a9e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:34.423420 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-69dda950-4dc0-46b2-88b2-4ffb82ce9a9e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.423910 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-69dda950-4dc0-46b2-88b2-4ffb82ce9a9e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.425518 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-69dda950-4dc0-46b2-88b2-4ffb82ce9a9e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.426064 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-69dda950-4dc0-46b2-88b2-4ffb82ce9a9e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.445695 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-953709ea-1522-4537-a3fc-51f99d7f6c01 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "POST /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307518 Jan 28 02:06:34.446702 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 402/789] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:06:34 2022] POST /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:34.540788 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-69dda950-4dc0-46b2-88b2-4ffb82ce9a9e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 28671 microversion: 2.20 time: 0.131316 Jan 28 02:06:34.541538 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 388/790] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:34 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 28671 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:35.554009 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bad669be-31cd-4d40-899b-892e8e2bc161 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:35.555411 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bad669be-31cd-4d40-899b-892e8e2bc161 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:35.563500 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bad669be-31cd-4d40-899b-892e8e2bc161 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:35.564045 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bad669be-31cd-4d40-899b-892e8e2bc161 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:35.565501 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bad669be-31cd-4d40-899b-892e8e2bc161 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:35.566054 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bad669be-31cd-4d40-899b-892e8e2bc161 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:35.680893 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-bad669be-31cd-4d40-899b-892e8e2bc161 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 29384 microversion: 2.20 time: 0.131565 Jan 28 02:06:35.685044 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 403/791] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:35 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 29384 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:36.693435 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3f578e76-4978-40fc-aaa3-d6d19b2cd713 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:36.694769 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3f578e76-4978-40fc-aaa3-d6d19b2cd713 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:36.702372 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3f578e76-4978-40fc-aaa3-d6d19b2cd713 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:36.703015 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3f578e76-4978-40fc-aaa3-d6d19b2cd713 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:36.704166 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3f578e76-4978-40fc-aaa3-d6d19b2cd713 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:36.704740 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3f578e76-4978-40fc-aaa3-d6d19b2cd713 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:36.823147 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3f578e76-4978-40fc-aaa3-d6d19b2cd713 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 31397 microversion: 2.20 time: 0.133963 Jan 28 02:06:36.824139 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 389/792] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:36 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 31397 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:37.835104 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1e806f5d-15df-4704-a70a-84e34df77677 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:37.836120 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1e806f5d-15df-4704-a70a-84e34df77677 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:37.843162 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1e806f5d-15df-4704-a70a-84e34df77677 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:37.843666 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1e806f5d-15df-4704-a70a-84e34df77677 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:37.844469 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1e806f5d-15df-4704-a70a-84e34df77677 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:37.844896 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1e806f5d-15df-4704-a70a-84e34df77677 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:37.943333 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1e806f5d-15df-4704-a70a-84e34df77677 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 33405 microversion: 2.20 time: 0.112120 Jan 28 02:06:37.944420 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 404/793] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:37 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 33405 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:38.957152 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-588c9a43-ea62-4450-8b59-a90b7ae1c99e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:38.958924 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-588c9a43-ea62-4450-8b59-a90b7ae1c99e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:38.966040 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-588c9a43-ea62-4450-8b59-a90b7ae1c99e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:38.966788 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-588c9a43-ea62-4450-8b59-a90b7ae1c99e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:38.967749 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-588c9a43-ea62-4450-8b59-a90b7ae1c99e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:38.968349 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-588c9a43-ea62-4450-8b59-a90b7ae1c99e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:39.072146 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-588c9a43-ea62-4450-8b59-a90b7ae1c99e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 34464 microversion: 2.20 time: 0.120227 Jan 28 02:06:39.072790 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 390/794] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:38 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 34464 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:06:40.085535 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-40ee0e2b-de10-49e7-abb3-57c90a783f53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:40.087209 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-40ee0e2b-de10-49e7-abb3-57c90a783f53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:40.094834 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-40ee0e2b-de10-49e7-abb3-57c90a783f53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:40.099825 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-40ee0e2b-de10-49e7-abb3-57c90a783f53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.100864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-40ee0e2b-de10-49e7-abb3-57c90a783f53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:40.101242 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-40ee0e2b-de10-49e7-abb3-57c90a783f53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.204266 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-40ee0e2b-de10-49e7-abb3-57c90a783f53 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 35322 microversion: 2.20 time: 0.123646 Jan 28 02:06:40.205353 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 405/795] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:40 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 35322 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:41.223076 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-42de5c71-e2d8-4a8f-8fff-70762a23d0a5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:41.225003 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-42de5c71-e2d8-4a8f-8fff-70762a23d0a5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:41.231686 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-42de5c71-e2d8-4a8f-8fff-70762a23d0a5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:41.232131 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-42de5c71-e2d8-4a8f-8fff-70762a23d0a5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:41.232903 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-42de5c71-e2d8-4a8f-8fff-70762a23d0a5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:41.233506 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-42de5c71-e2d8-4a8f-8fff-70762a23d0a5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:41.332561 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-42de5c71-e2d8-4a8f-8fff-70762a23d0a5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 36061 microversion: 2.20 time: 0.118765 Jan 28 02:06:41.336710 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 391/796] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:41 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 36061 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:42.345257 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-feafcb94-680c-44c7-97d6-c3ea06e91eb4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:42.347146 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-feafcb94-680c-44c7-97d6-c3ea06e91eb4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:42.353780 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-feafcb94-680c-44c7-97d6-c3ea06e91eb4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:42.354580 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-feafcb94-680c-44c7-97d6-c3ea06e91eb4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:42.355434 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-feafcb94-680c-44c7-97d6-c3ea06e91eb4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:42.356066 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-feafcb94-680c-44c7-97d6-c3ea06e91eb4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:42.464778 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-feafcb94-680c-44c7-97d6-c3ea06e91eb4 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 37278 microversion: 2.20 time: 0.123511 Jan 28 02:06:42.466501 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 406/797] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:42 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 37278 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:43.477376 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ffc72742-54d0-44a0-a4a1-778208a964d8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:43.478431 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ffc72742-54d0-44a0-a4a1-778208a964d8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:43.485121 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ffc72742-54d0-44a0-a4a1-778208a964d8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:43.485575 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ffc72742-54d0-44a0-a4a1-778208a964d8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:43.486915 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ffc72742-54d0-44a0-a4a1-778208a964d8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:43.487365 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ffc72742-54d0-44a0-a4a1-778208a964d8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.103775 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ffc72742-54d0-44a0-a4a1-778208a964d8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 38226 microversion: 2.20 time: 1.630459 Jan 28 02:06:45.105114 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 392/798] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:43 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 38226 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:46.118347 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-da27dedb-b405-4327-b28e-653e504208f9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:46.119331 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-da27dedb-b405-4327-b28e-653e504208f9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:46.135410 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-da27dedb-b405-4327-b28e-653e504208f9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:46.136044 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-da27dedb-b405-4327-b28e-653e504208f9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:46.137206 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-da27dedb-b405-4327-b28e-653e504208f9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:46.137641 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-da27dedb-b405-4327-b28e-653e504208f9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:46.242639 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-da27dedb-b405-4327-b28e-653e504208f9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 38226 microversion: 2.20 time: 0.129072 Jan 28 02:06:46.243389 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 407/799] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:46 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 38226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:47.279074 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-67e5ab9f-1968-4ce8-bccd-0ee6a9488268 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:47.280050 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-67e5ab9f-1968-4ce8-bccd-0ee6a9488268 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:47.290279 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-67e5ab9f-1968-4ce8-bccd-0ee6a9488268 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.290720 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-67e5ab9f-1968-4ce8-bccd-0ee6a9488268 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:47.291499 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-67e5ab9f-1968-4ce8-bccd-0ee6a9488268 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.291935 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-67e5ab9f-1968-4ce8-bccd-0ee6a9488268 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:49.568181 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-67e5ab9f-1968-4ce8-bccd-0ee6a9488268 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 200 len: 38369 microversion: 2.20 time: 2.316016 Jan 28 02:06:49.568856 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 393/800] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:47 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 38369 bytes in 2318 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:49.580243 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-465a3540-54e3-4460-86ab-37cf501a3064 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:49.580822 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-465a3540-54e3-4460-86ab-37cf501a3064 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:49.588787 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-465a3540-54e3-4460-86ab-37cf501a3064 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:49.589347 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-465a3540-54e3-4460-86ab-37cf501a3064 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:49.590209 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-465a3540-54e3-4460-86ab-37cf501a3064 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:49.590868 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-465a3540-54e3-4460-86ab-37cf501a3064 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:49.618574 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-465a3540-54e3-4460-86ab-37cf501a3064 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/ips" status: 200 len: 152 microversion: 2.20 time: 0.042417 Jan 28 02:06:49.620260 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 408/801] 10.222.0.77 () {60 vars in 1288 bytes} [Fri Jan 28 02:06:49 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:06:51.355794 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-02ebff7b-beb0-445c-91d1-7c87842f816f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Action: 'create', calling method: .version_select at 0x7f08d5daed30>, body: {"keypair": {"name": "tempest-TestShelveInstance-576847230"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:51.374035 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-02ebff7b-beb0-445c-91d1-7c87842f816f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Getting quotas for project 226f951c63d84729beaecf1a55d5a6a8. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:51.377538 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-02ebff7b-beb0-445c-91d1-7c87842f816f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Getting quotas for user a0b99882e3054e8da1240d6285ff0565 and project 226f951c63d84729beaecf1a55d5a6a8. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:51.584395 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-02ebff7b-beb0-445c-91d1-7c87842f816f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Getting quotas for project 226f951c63d84729beaecf1a55d5a6a8. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:51.587963 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-02ebff7b-beb0-445c-91d1-7c87842f816f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Getting quotas for user a0b99882e3054e8da1240d6285ff0565 and project 226f951c63d84729beaecf1a55d5a6a8. Resources: {'key_pairs'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:51.601362 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-02ebff7b-beb0-445c-91d1-7c87842f816f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.437832 Jan 28 02:06:51.601986 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 394/802] 10.222.0.77 () {60 vars in 1157 bytes} [Fri Jan 28 02:06:51 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:58.356893 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0320b480-5a2f-485c-817f-6b2c66286295 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:58.357424 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0320b480-5a2f-485c-817f-6b2c66286295 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:58.365241 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0320b480-5a2f-485c-817f-6b2c66286295 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:58.365786 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0320b480-5a2f-485c-817f-6b2c66286295 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:58.366577 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0320b480-5a2f-485c-817f-6b2c66286295 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:58.367014 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0320b480-5a2f-485c-817f-6b2c66286295 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:58.454788 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-0320b480-5a2f-485c-817f-6b2c66286295 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lazy-loading 'services' on Instance uuid 9aeab016-de44-4bfb-af1e-8d7282e55502 {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:06:58.519238 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0320b480-5a2f-485c-817f-6b2c66286295 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "DELETE /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502/os-volume_attachments/5b1e75a1-32e9-4cf5-894d-07ce31c84f6c" status: 202 len: 0 microversion: 2.1 time: 0.166106 Jan 28 02:06:58.519765 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 409/803] 10.222.0.77 () {58 vars in 1415 bytes} [Fri Jan 28 02:06:58 2022] DELETE /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502/os-volume_attachments/5b1e75a1-32e9-4cf5-894d-07ce31c84f6c => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:59.645309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-516fe97d-43a3-46a1-ac83-570aff780c70 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:59.645970 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-516fe97d-43a3-46a1-ac83-570aff780c70 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:59.654066 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-516fe97d-43a3-46a1-ac83-570aff780c70 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:59.654436 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-516fe97d-43a3-46a1-ac83-570aff780c70 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:59.655222 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-516fe97d-43a3-46a1-ac83-570aff780c70 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:59.655654 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-516fe97d-43a3-46a1-ac83-570aff780c70 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:59.680642 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-516fe97d-43a3-46a1-ac83-570aff780c70 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:06:59.758500 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-516fe97d-43a3-46a1-ac83-570aff780c70 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "DELETE /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 204 len: 0 microversion: 2.1 time: 0.117405 Jan 28 02:06:59.759379 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 395/804] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:06:59 2022] DELETE /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:06:59.769101 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-181fb28b-d2ef-4317-b40b-a7621f49a270 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:59.769809 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-181fb28b-d2ef-4317-b40b-a7621f49a270 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:59.775751 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-181fb28b-d2ef-4317-b40b-a7621f49a270 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:59.776192 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-181fb28b-d2ef-4317-b40b-a7621f49a270 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:59.776947 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-181fb28b-d2ef-4317-b40b-a7621f49a270 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:59.777373 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-181fb28b-d2ef-4317-b40b-a7621f49a270 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:59.900355 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-181fb28b-d2ef-4317-b40b-a7621f49a270 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:59.907853 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-181fb28b-d2ef-4317-b40b-a7621f49a270 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 200 len: 1514 microversion: 2.1 time: 0.143156 Jan 28 02:06:59.908945 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 410/805] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:59 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:00.925693 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6de6e802-f8c0-4195-a48d-a114cddce218 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:00.926413 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6de6e802-f8c0-4195-a48d-a114cddce218 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:00.932220 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6de6e802-f8c0-4195-a48d-a114cddce218 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:00.932608 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6de6e802-f8c0-4195-a48d-a114cddce218 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:00.933391 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6de6e802-f8c0-4195-a48d-a114cddce218 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:00.933847 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6de6e802-f8c0-4195-a48d-a114cddce218 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:01.057146 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-6de6e802-f8c0-4195-a48d-a114cddce218 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:01.065340 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6de6e802-f8c0-4195-a48d-a114cddce218 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 200 len: 1514 microversion: 2.1 time: 0.142833 Jan 28 02:07:01.065927 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 396/806] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:00 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:02.085297 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-90700872-709e-4312-89e0-3228ffeda065 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:02.086037 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-90700872-709e-4312-89e0-3228ffeda065 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:02.092229 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-90700872-709e-4312-89e0-3228ffeda065 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:02.092677 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-90700872-709e-4312-89e0-3228ffeda065 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:02.093462 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-90700872-709e-4312-89e0-3228ffeda065 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:02.093919 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-90700872-709e-4312-89e0-3228ffeda065 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:02.222247 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-90700872-709e-4312-89e0-3228ffeda065 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:02.229769 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-90700872-709e-4312-89e0-3228ffeda065 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 200 len: 1514 microversion: 2.1 time: 0.148536 Jan 28 02:07:02.230436 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 411/807] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:02 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:02.313881 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-995a6f90-47a2-435a-b89f-38e8d68514ba req-1e371bc1-ea49-49a2-aba0-957d02c376fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aeab016-de44-4bfb-af1e-8d7282e55502", "name": "network-vif-deleted", "tag": "2f49cc6d-5280-48fc-82bb-ac87442b2506"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:02.315987 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:02.315987 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:07:02.327084 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-995a6f90-47a2-435a-b89f-38e8d68514ba req-1e371bc1-ea49-49a2-aba0-957d02c376fa service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:02.327563 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-995a6f90-47a2-435a-b89f-38e8d68514ba req-1e371bc1-ea49-49a2-aba0-957d02c376fa service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:02.339337 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-995a6f90-47a2-435a-b89f-38e8d68514ba req-1e371bc1-ea49-49a2-aba0-957d02c376fa service nova] Creating event network-vif-deleted:2f49cc6d-5280-48fc-82bb-ac87442b2506 for instance 9aeab016-de44-4bfb-af1e-8d7282e55502 on hv-cinder-82497 Jan 28 02:07:02.344437 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-995a6f90-47a2-435a-b89f-38e8d68514ba req-1e371bc1-ea49-49a2-aba0-957d02c376fa service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092560 Jan 28 02:07:02.345237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 397/808] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:03.247717 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d0c597a5-f53a-48c6-9b2a-f26f588d4757 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:03.248314 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d0c597a5-f53a-48c6-9b2a-f26f588d4757 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: 9aeab016-de44-4bfb-af1e-8d7282e55502] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:03.254325 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d0c597a5-f53a-48c6-9b2a-f26f588d4757 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:03.254765 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d0c597a5-f53a-48c6-9b2a-f26f588d4757 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:03.255537 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d0c597a5-f53a-48c6-9b2a-f26f588d4757 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:03.255961 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d0c597a5-f53a-48c6-9b2a-f26f588d4757 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:03.269260 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-d0c597a5-f53a-48c6-9b2a-f26f588d4757 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] HTTP exception thrown: Instance 9aeab016-de44-4bfb-af1e-8d7282e55502 could not be found. Jan 28 02:07:03.269865 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d0c597a5-f53a-48c6-9b2a-f26f588d4757 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Returning 404 to user: Instance 9aeab016-de44-4bfb-af1e-8d7282e55502 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:07:03.270685 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d0c597a5-f53a-48c6-9b2a-f26f588d4757 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502" status: 404 len: 111 microversion: 2.1 time: 0.027482 Jan 28 02:07:03.271362 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 412/809] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:03 2022] GET /compute/v2.1/servers/9aeab016-de44-4bfb-af1e-8d7282e55502 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:07:07.593958 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-cb38d504-8d3a-4cd2-9659-e7db16ee461b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:07.594678 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-cb38d504-8d3a-4cd2-9659-e7db16ee461b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:07.600935 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cb38d504-8d3a-4cd2-9659-e7db16ee461b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:07.601448 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cb38d504-8d3a-4cd2-9659-e7db16ee461b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:07.602314 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cb38d504-8d3a-4cd2-9659-e7db16ee461b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:07.602743 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cb38d504-8d3a-4cd2-9659-e7db16ee461b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:07.626164 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.objects.instance [None req-cb38d504-8d3a-4cd2-9659-e7db16ee461b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lazy-loading 'flavor' on Instance uuid 7cce5b81-d0cd-4833-a177-47b577b84152 {{(pid=115760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:07:07.896629 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-cb38d504-8d3a-4cd2-9659-e7db16ee461b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 202 len: 0 microversion: 2.20 time: 0.306850 Jan 28 02:07:07.897395 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 398/810] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:07 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:07:07.905971 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6e169075-35e8-49d7-ae2a-d0c68d9e8d95 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:07.906659 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6e169075-35e8-49d7-ae2a-d0c68d9e8d95 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:07.913937 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6e169075-35e8-49d7-ae2a-d0c68d9e8d95 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:07.914582 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6e169075-35e8-49d7-ae2a-d0c68d9e8d95 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:07.915609 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6e169075-35e8-49d7-ae2a-d0c68d9e8d95 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:07.916061 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6e169075-35e8-49d7-ae2a-d0c68d9e8d95 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:08.040634 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6e169075-35e8-49d7-ae2a-d0c68d9e8d95 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:08.048446 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6e169075-35e8-49d7-ae2a-d0c68d9e8d95 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:08.050734 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6e169075-35e8-49d7-ae2a-d0c68d9e8d95 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:08.051898 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6e169075-35e8-49d7-ae2a-d0c68d9e8d95 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1724 microversion: 2.20 time: 0.150021 Jan 28 02:07:08.052449 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 413/811] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:07 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:09.071808 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2558af2a-33cf-4825-b3cc-290219d44f83 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:09.072415 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2558af2a-33cf-4825-b3cc-290219d44f83 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:09.078988 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2558af2a-33cf-4825-b3cc-290219d44f83 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:09.079440 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2558af2a-33cf-4825-b3cc-290219d44f83 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:09.080814 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2558af2a-33cf-4825-b3cc-290219d44f83 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:09.081244 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2558af2a-33cf-4825-b3cc-290219d44f83 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:09.211270 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-2558af2a-33cf-4825-b3cc-290219d44f83 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:09.218888 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-2558af2a-33cf-4825-b3cc-290219d44f83 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:09.220378 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-2558af2a-33cf-4825-b3cc-290219d44f83 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:09.221557 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2558af2a-33cf-4825-b3cc-290219d44f83 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1724 microversion: 2.20 time: 0.154301 Jan 28 02:07:09.222143 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 399/812] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:09 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:10.239753 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d894d6c2-f195-4de4-898e-30bf922a714b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:10.240358 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d894d6c2-f195-4de4-898e-30bf922a714b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:10.246403 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d894d6c2-f195-4de4-898e-30bf922a714b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:10.246986 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d894d6c2-f195-4de4-898e-30bf922a714b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:10.247572 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d894d6c2-f195-4de4-898e-30bf922a714b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:10.248003 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d894d6c2-f195-4de4-898e-30bf922a714b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:10.374441 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d894d6c2-f195-4de4-898e-30bf922a714b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:10.382366 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d894d6c2-f195-4de4-898e-30bf922a714b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:10.383864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d894d6c2-f195-4de4-898e-30bf922a714b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:10.385012 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d894d6c2-f195-4de4-898e-30bf922a714b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1724 microversion: 2.20 time: 0.149025 Jan 28 02:07:10.385564 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 414/813] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:10 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:11.403417 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-985f47ff-8a70-424e-8d6a-c6ffb1903df2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:11.404019 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-985f47ff-8a70-424e-8d6a-c6ffb1903df2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:11.410085 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-985f47ff-8a70-424e-8d6a-c6ffb1903df2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:11.410526 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-985f47ff-8a70-424e-8d6a-c6ffb1903df2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:11.411295 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-985f47ff-8a70-424e-8d6a-c6ffb1903df2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:11.411720 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-985f47ff-8a70-424e-8d6a-c6ffb1903df2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:11.532280 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-985f47ff-8a70-424e-8d6a-c6ffb1903df2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:11.539974 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-985f47ff-8a70-424e-8d6a-c6ffb1903df2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:11.541455 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-985f47ff-8a70-424e-8d6a-c6ffb1903df2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:11.542634 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-985f47ff-8a70-424e-8d6a-c6ffb1903df2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1724 microversion: 2.20 time: 0.142942 Jan 28 02:07:11.543477 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 400/814] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:11 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:12.560374 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-51181775-fcaf-41f6-887b-00d271b6c22a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:12.560952 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-51181775-fcaf-41f6-887b-00d271b6c22a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:12.566960 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-51181775-fcaf-41f6-887b-00d271b6c22a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:12.567402 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-51181775-fcaf-41f6-887b-00d271b6c22a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:12.568413 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-51181775-fcaf-41f6-887b-00d271b6c22a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:12.568844 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-51181775-fcaf-41f6-887b-00d271b6c22a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:12.686867 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-51181775-fcaf-41f6-887b-00d271b6c22a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:12.695017 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-51181775-fcaf-41f6-887b-00d271b6c22a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:12.696538 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-51181775-fcaf-41f6-887b-00d271b6c22a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:12.697702 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-51181775-fcaf-41f6-887b-00d271b6c22a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1724 microversion: 2.20 time: 0.141093 Jan 28 02:07:12.698313 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 415/815] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:12 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:07:13.095920 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-935858392", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "networks": [{"uuid": "15196eb6-806a-4b15-875b-747d0ec1afab"}]}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:13.146215 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.network.neutron [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] validate_networks() for [('15196eb6-806a-4b15-875b-747d0ec1afab', None, None, None, None, None)] {{(pid=115760) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:07:13.572110 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Flavor limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:07:13.572529 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Image limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:07:13.573000 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Flavor pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:07:13.573403 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Image pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:07:13.573841 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:07:13.582350 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:13.582792 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:13.583586 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:13.584016 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:13.600694 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Getting quotas for project 2f9f6ec5f21a4775a393a6e55e34b617. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:07:13.604510 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Getting quotas for user 0ca9e2035efb4434939b300e1fbe6e2b and project 2f9f6ec5f21a4775a393a6e55e34b617. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:07:13.615473 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Going to run 1 instances... {{(pid=115760) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:07:13.617770 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:07:13.662116 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-689d6665-0773-4e78-9154-54310ee81573 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569714 Jan 28 02:07:13.662756 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 401/816] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:07:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:07:13.672540 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a0f5070e-1353-4d91-940a-4c2cde196a78 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:13.673175 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a0f5070e-1353-4d91-940a-4c2cde196a78 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:13.716512 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-bb3be920-ef55-4de3-955c-ccdd51f93833 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:13.717126 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-bb3be920-ef55-4de3-955c-ccdd51f93833 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:13.725122 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bb3be920-ef55-4de3-955c-ccdd51f93833 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:13.728257 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a0f5070e-1353-4d91-940a-4c2cde196a78 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:13.730155 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bb3be920-ef55-4de3-955c-ccdd51f93833 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:13.731156 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bb3be920-ef55-4de3-955c-ccdd51f93833 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:13.731727 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bb3be920-ef55-4de3-955c-ccdd51f93833 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:13.734673 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a0f5070e-1353-4d91-940a-4c2cde196a78 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1218 microversion: 2.1 time: 0.065886 Jan 28 02:07:13.735235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 416/817] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:13 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:13.862827 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bb3be920-ef55-4de3-955c-ccdd51f93833 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:13.871427 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bb3be920-ef55-4de3-955c-ccdd51f93833 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:13.872934 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bb3be920-ef55-4de3-955c-ccdd51f93833 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:13.874191 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-bb3be920-ef55-4de3-955c-ccdd51f93833 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1724 microversion: 2.20 time: 0.161646 Jan 28 02:07:13.874974 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 402/818] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:13 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:07:14.192351 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-930793198", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-576847230", "security_groups": [{"name": "tempest-secgroup-smoke-45617287"}], "networks": [{"uuid": "23a28d37-0005-458c-a7f4-ea41e10faeb4"}], "block_device_mapping_v2": [{"uuid": "c842d78f-b5c9-4605-8b32-6b990d13968c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:14.304973 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.network.neutron [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] validate_networks() for [('23a28d37-0005-458c-a7f4-ea41e10faeb4', None, None, None, None, None)] {{(pid=115761) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:07:14.718210 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Flavor limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:07:14.719056 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Image limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:07:14.719536 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Flavor pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:07:14.719945 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Image pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:07:14.720362 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:07:14.728932 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.729377 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.730207 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.730654 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.748051 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Getting quotas for project 226f951c63d84729beaecf1a55d5a6a8. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:07:14.752741 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Getting quotas for user a0b99882e3054e8da1240d6285ff0565 and project 226f951c63d84729beaecf1a55d5a6a8. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:07:14.753068 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5499cec3-26dc-4f0a-8a09-65a43acaf00d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:14.753773 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5499cec3-26dc-4f0a-8a09-65a43acaf00d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:14.760450 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5499cec3-26dc-4f0a-8a09-65a43acaf00d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.760981 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5499cec3-26dc-4f0a-8a09-65a43acaf00d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.761876 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5499cec3-26dc-4f0a-8a09-65a43acaf00d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.762748 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5499cec3-26dc-4f0a-8a09-65a43acaf00d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.826323 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Going to run 1 instances... {{(pid=115761) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:07:14.829373 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c842d78f-b5c9-4605-8b32-6b990d13968c',volume_size=None,volume_type=None)] {{(pid=115761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:07:14.831443 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5499cec3-26dc-4f0a-8a09-65a43acaf00d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:14.841662 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5499cec3-26dc-4f0a-8a09-65a43acaf00d tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1270 microversion: 2.1 time: 0.092805 Jan 28 02:07:14.842969 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 403/819] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:14 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:14.896023 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-966fe760-973e-4eb8-a274-52114e1dd170 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:14.896989 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-966fe760-973e-4eb8-a274-52114e1dd170 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:14.905679 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-966fe760-973e-4eb8-a274-52114e1dd170 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.906510 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-966fe760-973e-4eb8-a274-52114e1dd170 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.907396 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-966fe760-973e-4eb8-a274-52114e1dd170 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.908048 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-966fe760-973e-4eb8-a274-52114e1dd170 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.993774 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-bedae01e-0806-4f14-8c26-9e422b958bd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.805092 Jan 28 02:07:14.995005 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 417/820] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:07:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:07:15.009768 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0d8c00bf-9a74-4a6c-b031-f256cf2c06bf tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:15.010521 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0d8c00bf-9a74-4a6c-b031-f256cf2c06bf tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:15.086712 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0d8c00bf-9a74-4a6c-b031-f256cf2c06bf tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:15.089854 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-966fe760-973e-4eb8-a274-52114e1dd170 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:15.093555 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0d8c00bf-9a74-4a6c-b031-f256cf2c06bf tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1087 microversion: 2.1 time: 0.089984 Jan 28 02:07:15.094358 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 418/821] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:15 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1087 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:15.100556 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-966fe760-973e-4eb8-a274-52114e1dd170 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:15.102080 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-966fe760-973e-4eb8-a274-52114e1dd170 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:15.103407 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-966fe760-973e-4eb8-a274-52114e1dd170 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1724 microversion: 2.20 time: 0.214584 Jan 28 02:07:15.104157 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 404/822] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:14 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:07:15.858985 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2d34d4a9-fcd4-498c-ada0-7b6c280e029c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:15.859688 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-2d34d4a9-fcd4-498c-ada0-7b6c280e029c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:15.866074 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2d34d4a9-fcd4-498c-ada0-7b6c280e029c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:15.866515 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2d34d4a9-fcd4-498c-ada0-7b6c280e029c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:15.867281 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2d34d4a9-fcd4-498c-ada0-7b6c280e029c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:15.867709 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2d34d4a9-fcd4-498c-ada0-7b6c280e029c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.114989 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b6f5f04b-06ed-4359-a0b4-77d7784098e5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:16.116679 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b6f5f04b-06ed-4359-a0b4-77d7784098e5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:16.124836 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b6f5f04b-06ed-4359-a0b4-77d7784098e5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.125678 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b6f5f04b-06ed-4359-a0b4-77d7784098e5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.127484 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b6f5f04b-06ed-4359-a0b4-77d7784098e5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.128170 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b6f5f04b-06ed-4359-a0b4-77d7784098e5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.259789 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b6f5f04b-06ed-4359-a0b4-77d7784098e5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:16.275562 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-2d34d4a9-fcd4-498c-ada0-7b6c280e029c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:16.275883 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b6f5f04b-06ed-4359-a0b4-77d7784098e5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1203 microversion: 2.1 time: 0.168157 Jan 28 02:07:16.283381 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2d34d4a9-fcd4-498c-ada0-7b6c280e029c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1318 microversion: 2.1 time: 0.428043 Jan 28 02:07:16.286512 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 419/823] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:15 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:16.287151 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 405/824] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:16 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:16.291382 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c788c7ed-845d-47db-9cd8-2f053ae1ffab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:16.292157 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c788c7ed-845d-47db-9cd8-2f053ae1ffab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:16.299757 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c788c7ed-845d-47db-9cd8-2f053ae1ffab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.300195 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c788c7ed-845d-47db-9cd8-2f053ae1ffab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.300968 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c788c7ed-845d-47db-9cd8-2f053ae1ffab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.301818 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c788c7ed-845d-47db-9cd8-2f053ae1ffab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.444004 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c788c7ed-845d-47db-9cd8-2f053ae1ffab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:16.451785 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c788c7ed-845d-47db-9cd8-2f053ae1ffab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:16.453269 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c788c7ed-845d-47db-9cd8-2f053ae1ffab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:16.454448 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c788c7ed-845d-47db-9cd8-2f053ae1ffab tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1724 microversion: 2.20 time: 0.169173 Jan 28 02:07:16.455023 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 420/825] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:16 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:16.576321 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-936388cd-5961-4f4a-b415-f1e5d72f8e34 req-274ed695-d17c-4193-a842-e5014e7238b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e849a0fd-94c7-447c-8cbb-3e2f8ff67537", "tag": "5cec5ab9-7bf7-4dfd-85e2-0e8b712b54e8"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:16.578653 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:16.578653 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:07:16.588572 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-936388cd-5961-4f4a-b415-f1e5d72f8e34 req-274ed695-d17c-4193-a842-e5014e7238b1 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.589025 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-936388cd-5961-4f4a-b415-f1e5d72f8e34 req-274ed695-d17c-4193-a842-e5014e7238b1 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.602315 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-936388cd-5961-4f4a-b415-f1e5d72f8e34 req-274ed695-d17c-4193-a842-e5014e7238b1 service nova] Creating event network-changed:5cec5ab9-7bf7-4dfd-85e2-0e8b712b54e8 for instance e849a0fd-94c7-447c-8cbb-3e2f8ff67537 on hv-cinder-82497 Jan 28 02:07:16.608058 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-936388cd-5961-4f4a-b415-f1e5d72f8e34 req-274ed695-d17c-4193-a842-e5014e7238b1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038634 Jan 28 02:07:16.609114 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 406/826] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:17.294702 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-71331da8-9a05-4de7-8a21-5af025c69f04 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:17.300739 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-63b877a7-a56e-49f5-9a94-b5c1adc15563 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:17.302247 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-63b877a7-a56e-49f5-9a94-b5c1adc15563 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:17.305504 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-71331da8-9a05-4de7-8a21-5af025c69f04 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:17.311756 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-63b877a7-a56e-49f5-9a94-b5c1adc15563 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:17.315682 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-71331da8-9a05-4de7-8a21-5af025c69f04 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:17.316202 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-63b877a7-a56e-49f5-9a94-b5c1adc15563 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.317080 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-63b877a7-a56e-49f5-9a94-b5c1adc15563 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:17.317659 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-63b877a7-a56e-49f5-9a94-b5c1adc15563 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.320963 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-71331da8-9a05-4de7-8a21-5af025c69f04 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.321917 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-71331da8-9a05-4de7-8a21-5af025c69f04 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:17.322583 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-71331da8-9a05-4de7-8a21-5af025c69f04 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.622510 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-63b877a7-a56e-49f5-9a94-b5c1adc15563 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:17.631938 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-63b877a7-a56e-49f5-9a94-b5c1adc15563 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1318 microversion: 2.1 time: 0.334974 Jan 28 02:07:17.641927 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 407/827] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:17 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:17.643356 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-71331da8-9a05-4de7-8a21-5af025c69f04 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:17.649811 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c979d791-8ae6-40fb-b3ab-312d46941265 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:17.650614 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c979d791-8ae6-40fb-b3ab-312d46941265 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:17.655555 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-71331da8-9a05-4de7-8a21-5af025c69f04 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.366406 Jan 28 02:07:17.657171 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c979d791-8ae6-40fb-b3ab-312d46941265 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:17.657833 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c979d791-8ae6-40fb-b3ab-312d46941265 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.658856 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c979d791-8ae6-40fb-b3ab-312d46941265 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:17.659522 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c979d791-8ae6-40fb-b3ab-312d46941265 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.666703 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 421/828] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:17 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:17.910099 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c979d791-8ae6-40fb-b3ab-312d46941265 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:17.920422 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c979d791-8ae6-40fb-b3ab-312d46941265 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:17.922161 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c979d791-8ae6-40fb-b3ab-312d46941265 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:17.923440 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c979d791-8ae6-40fb-b3ab-312d46941265 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1724 microversion: 2.20 time: 0.279902 Jan 28 02:07:17.924655 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 408/829] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:17 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:18.627455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-1c075ad9-f952-479b-9b13-ec1cc2404dd3 req-b0faca9c-8125-4171-af40-c672cd47529d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63f7e8f-3a5e-4636-8231-688a4b068f3a", "tag": "862311b2-2f81-451f-a875-dbcc86e8b247"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:18.629942 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:18.629942 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:07:18.637393 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-1c075ad9-f952-479b-9b13-ec1cc2404dd3 req-b0faca9c-8125-4171-af40-c672cd47529d service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.637848 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-1c075ad9-f952-479b-9b13-ec1cc2404dd3 req-b0faca9c-8125-4171-af40-c672cd47529d service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:18.648357 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7de7478d-22c9-47f8-a827-4f28c818a775 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:18.649573 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7de7478d-22c9-47f8-a827-4f28c818a775 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:18.653940 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-1c075ad9-f952-479b-9b13-ec1cc2404dd3 req-b0faca9c-8125-4171-af40-c672cd47529d service nova] Creating event network-changed:862311b2-2f81-451f-a875-dbcc86e8b247 for instance e63f7e8f-3a5e-4636-8231-688a4b068f3a on hv-cinder-82497 Jan 28 02:07:18.659379 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-1c075ad9-f952-479b-9b13-ec1cc2404dd3 req-b0faca9c-8125-4171-af40-c672cd47529d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036096 Jan 28 02:07:18.660512 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 422/830] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:18.661116 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7de7478d-22c9-47f8-a827-4f28c818a775 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.661606 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7de7478d-22c9-47f8-a827-4f28c818a775 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:18.662452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7de7478d-22c9-47f8-a827-4f28c818a775 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.662886 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7de7478d-22c9-47f8-a827-4f28c818a775 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:18.673077 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-63497fe9-5547-400c-bdc6-263ed46f41b5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:18.674591 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-63497fe9-5547-400c-bdc6-263ed46f41b5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:18.680923 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-63497fe9-5547-400c-bdc6-263ed46f41b5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.681373 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-63497fe9-5547-400c-bdc6-263ed46f41b5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:18.682203 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-63497fe9-5547-400c-bdc6-263ed46f41b5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.682631 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-63497fe9-5547-400c-bdc6-263ed46f41b5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:18.857890 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7de7478d-22c9-47f8-a827-4f28c818a775 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:18.865757 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7de7478d-22c9-47f8-a827-4f28c818a775 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1318 microversion: 2.1 time: 0.220968 Jan 28 02:07:18.866349 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 409/831] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:18 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:18.866532 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-63497fe9-5547-400c-bdc6-263ed46f41b5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:18.874553 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-63497fe9-5547-400c-bdc6-263ed46f41b5 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.205824 Jan 28 02:07:18.875123 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 423/832] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:18 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:18.942123 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c15793cd-8f01-4deb-a2ad-75c835becc5b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:18.942726 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c15793cd-8f01-4deb-a2ad-75c835becc5b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:18.948790 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c15793cd-8f01-4deb-a2ad-75c835becc5b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.949303 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c15793cd-8f01-4deb-a2ad-75c835becc5b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:18.950244 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c15793cd-8f01-4deb-a2ad-75c835becc5b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.950670 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c15793cd-8f01-4deb-a2ad-75c835becc5b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:19.080817 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c15793cd-8f01-4deb-a2ad-75c835becc5b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:19.088716 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c15793cd-8f01-4deb-a2ad-75c835becc5b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:19.090282 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c15793cd-8f01-4deb-a2ad-75c835becc5b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:19.091440 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c15793cd-8f01-4deb-a2ad-75c835becc5b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1745 microversion: 2.20 time: 0.153151 Jan 28 02:07:19.091998 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 410/833] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:18 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:19.882093 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5b892e33-346e-4498-b10e-e040255a1557 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:19.882680 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-5b892e33-346e-4498-b10e-e040255a1557 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:19.888987 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5b892e33-346e-4498-b10e-e040255a1557 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:19.889429 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5b892e33-346e-4498-b10e-e040255a1557 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:19.890333 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5b892e33-346e-4498-b10e-e040255a1557 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:19.890773 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5b892e33-346e-4498-b10e-e040255a1557 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:19.891077 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b0abddfc-423d-4a74-9dc7-76b1c3b53cbf tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:19.891704 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b0abddfc-423d-4a74-9dc7-76b1c3b53cbf tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:19.898365 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b0abddfc-423d-4a74-9dc7-76b1c3b53cbf tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:19.898817 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b0abddfc-423d-4a74-9dc7-76b1c3b53cbf tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:19.899595 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b0abddfc-423d-4a74-9dc7-76b1c3b53cbf tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:19.900022 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b0abddfc-423d-4a74-9dc7-76b1c3b53cbf tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:20.070389 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-5b892e33-346e-4498-b10e-e040255a1557 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:20.075449 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b0abddfc-423d-4a74-9dc7-76b1c3b53cbf tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:20.077707 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-5b892e33-346e-4498-b10e-e040255a1557 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1318 microversion: 2.1 time: 0.199338 Jan 28 02:07:20.078334 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 424/834] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:19 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:20.083445 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b0abddfc-423d-4a74-9dc7-76b1c3b53cbf tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.195988 Jan 28 02:07:20.084002 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 411/835] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:19 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:20.111669 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-042836b4-628f-4efb-a53b-9d7b1c57a00a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:20.112275 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-042836b4-628f-4efb-a53b-9d7b1c57a00a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:20.118052 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-042836b4-628f-4efb-a53b-9d7b1c57a00a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:20.118497 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-042836b4-628f-4efb-a53b-9d7b1c57a00a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:20.119261 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-042836b4-628f-4efb-a53b-9d7b1c57a00a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:20.119687 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-042836b4-628f-4efb-a53b-9d7b1c57a00a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:20.239348 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-042836b4-628f-4efb-a53b-9d7b1c57a00a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:20.246908 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-042836b4-628f-4efb-a53b-9d7b1c57a00a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:20.248406 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-042836b4-628f-4efb-a53b-9d7b1c57a00a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:20.249563 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-042836b4-628f-4efb-a53b-9d7b1c57a00a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1745 microversion: 2.20 time: 0.142053 Jan 28 02:07:20.250149 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 425/836] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:20 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1745 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:21.108769 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ee50a9b3-2d2a-41cd-81c4-49ba6208092a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:21.110154 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ee50a9b3-2d2a-41cd-81c4-49ba6208092a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:21.111474 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f914e194-fb04-43a7-9a15-09eab6408a41 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:21.112819 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f914e194-fb04-43a7-9a15-09eab6408a41 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:21.121145 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f914e194-fb04-43a7-9a15-09eab6408a41 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:21.121762 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f914e194-fb04-43a7-9a15-09eab6408a41 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:21.127216 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f914e194-fb04-43a7-9a15-09eab6408a41 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:21.128038 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f914e194-fb04-43a7-9a15-09eab6408a41 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:21.129550 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ee50a9b3-2d2a-41cd-81c4-49ba6208092a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:21.132730 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ee50a9b3-2d2a-41cd-81c4-49ba6208092a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:21.133536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ee50a9b3-2d2a-41cd-81c4-49ba6208092a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:21.134002 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ee50a9b3-2d2a-41cd-81c4-49ba6208092a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:21.370854 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f914e194-fb04-43a7-9a15-09eab6408a41 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:21.388749 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ee50a9b3-2d2a-41cd-81c4-49ba6208092a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:21.397056 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f914e194-fb04-43a7-9a15-09eab6408a41 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.299673 Jan 28 02:07:21.401705 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ee50a9b3-2d2a-41cd-81c4-49ba6208092a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1318 microversion: 2.1 time: 0.310734 Jan 28 02:07:21.403032 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 426/837] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:21 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:21.408027 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7e1dc731-a164-436c-b5b3-fd4cd9099d44 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:21.409729 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 412/838] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:21 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:21.412063 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7e1dc731-a164-436c-b5b3-fd4cd9099d44 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:21.418811 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7e1dc731-a164-436c-b5b3-fd4cd9099d44 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:21.420170 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7e1dc731-a164-436c-b5b3-fd4cd9099d44 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:21.421530 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7e1dc731-a164-436c-b5b3-fd4cd9099d44 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:21.423061 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7e1dc731-a164-436c-b5b3-fd4cd9099d44 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:21.583932 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7e1dc731-a164-436c-b5b3-fd4cd9099d44 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:21.592727 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7e1dc731-a164-436c-b5b3-fd4cd9099d44 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:21.594190 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7e1dc731-a164-436c-b5b3-fd4cd9099d44 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:21.595498 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7e1dc731-a164-436c-b5b3-fd4cd9099d44 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1740 microversion: 2.20 time: 0.191053 Jan 28 02:07:21.596638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 427/839] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:21 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:22.426429 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-df621f7a-5f59-4ac8-a547-e5a4efbdcfa6 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:22.427995 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-cc004f70-5de7-4e43-b11a-b8439d4f8de2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:22.429141 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-df621f7a-5f59-4ac8-a547-e5a4efbdcfa6 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:22.432414 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-cc004f70-5de7-4e43-b11a-b8439d4f8de2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:22.439257 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-df621f7a-5f59-4ac8-a547-e5a4efbdcfa6 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:22.442832 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cc004f70-5de7-4e43-b11a-b8439d4f8de2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:22.443773 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cc004f70-5de7-4e43-b11a-b8439d4f8de2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:22.444315 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-df621f7a-5f59-4ac8-a547-e5a4efbdcfa6 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:22.445207 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-df621f7a-5f59-4ac8-a547-e5a4efbdcfa6 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:22.445645 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-df621f7a-5f59-4ac8-a547-e5a4efbdcfa6 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:22.451254 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cc004f70-5de7-4e43-b11a-b8439d4f8de2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:22.451688 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cc004f70-5de7-4e43-b11a-b8439d4f8de2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:22.681438 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-cc004f70-5de7-4e43-b11a-b8439d4f8de2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:22.688077 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-df621f7a-5f59-4ac8-a547-e5a4efbdcfa6 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:22.694263 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-cc004f70-5de7-4e43-b11a-b8439d4f8de2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.276991 Jan 28 02:07:22.697986 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-df621f7a-5f59-4ac8-a547-e5a4efbdcfa6 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1318 microversion: 2.1 time: 0.274946 Jan 28 02:07:22.708476 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 413/840] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:22 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:22.709292 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 428/841] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:22 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:22.720297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-24067a91-c834-4852-b21b-9566d9a0c84a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:22.721046 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-24067a91-c834-4852-b21b-9566d9a0c84a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:22.731147 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-24067a91-c834-4852-b21b-9566d9a0c84a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:22.731147 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-24067a91-c834-4852-b21b-9566d9a0c84a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:22.732560 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-24067a91-c834-4852-b21b-9566d9a0c84a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:22.733454 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-24067a91-c834-4852-b21b-9566d9a0c84a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:22.906505 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-24067a91-c834-4852-b21b-9566d9a0c84a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:22.915405 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-24067a91-c834-4852-b21b-9566d9a0c84a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:22.917373 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-24067a91-c834-4852-b21b-9566d9a0c84a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:22.919403 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-24067a91-c834-4852-b21b-9566d9a0c84a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1740 microversion: 2.20 time: 0.211810 Jan 28 02:07:22.930960 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 414/842] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:22 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:22.932804 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-80ab5382-1c31-42d3-87a1-915cec9397cf req-4052285a-485c-4d2a-86b0-7ba057842c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e849a0fd-94c7-447c-8cbb-3e2f8ff67537", "name": "network-vif-plugged", "status": "completed", "tag": "5cec5ab9-7bf7-4dfd-85e2-0e8b712b54e8"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:22.934626 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:22.934626 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:07:22.944199 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-80ab5382-1c31-42d3-87a1-915cec9397cf req-4052285a-485c-4d2a-86b0-7ba057842c36 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:22.945845 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-80ab5382-1c31-42d3-87a1-915cec9397cf req-4052285a-485c-4d2a-86b0-7ba057842c36 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:22.960039 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-80ab5382-1c31-42d3-87a1-915cec9397cf req-4052285a-485c-4d2a-86b0-7ba057842c36 service nova] Creating event network-vif-plugged:5cec5ab9-7bf7-4dfd-85e2-0e8b712b54e8 for instance e849a0fd-94c7-447c-8cbb-3e2f8ff67537 on hv-cinder-82497 Jan 28 02:07:22.966694 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-80ab5382-1c31-42d3-87a1-915cec9397cf req-4052285a-485c-4d2a-86b0-7ba057842c36 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130711 Jan 28 02:07:22.967916 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 429/843] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:07:23.712184 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9d9c0ab0-34f8-468e-97ee-9dd98e31417e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:23.712843 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9d9c0ab0-34f8-468e-97ee-9dd98e31417e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:23.716747 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-dfe6f0c2-9ca6-4786-9dbe-0b6564727188 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:23.717705 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-dfe6f0c2-9ca6-4786-9dbe-0b6564727188 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:23.719939 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9d9c0ab0-34f8-468e-97ee-9dd98e31417e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:23.720388 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9d9c0ab0-34f8-468e-97ee-9dd98e31417e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:23.721795 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9d9c0ab0-34f8-468e-97ee-9dd98e31417e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:23.722237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9d9c0ab0-34f8-468e-97ee-9dd98e31417e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:23.725733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dfe6f0c2-9ca6-4786-9dbe-0b6564727188 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:23.726496 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dfe6f0c2-9ca6-4786-9dbe-0b6564727188 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:23.727534 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dfe6f0c2-9ca6-4786-9dbe-0b6564727188 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:23.727978 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dfe6f0c2-9ca6-4786-9dbe-0b6564727188 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:23.945386 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9d9c0ab0-34f8-468e-97ee-9dd98e31417e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:23.958189 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9d9c0ab0-34f8-468e-97ee-9dd98e31417e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.249774 Jan 28 02:07:23.961731 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dfe6f0c2-9ca6-4786-9dbe-0b6564727188 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:23.968186 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 415/844] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:23 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:23.972165 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-dfe6f0c2-9ca6-4786-9dbe-0b6564727188 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1318 microversion: 2.1 time: 0.259608 Jan 28 02:07:23.972761 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 430/845] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:23 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:23.974642 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5a3cc3ba-e1f6-4050-b71d-9f471113a8e8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:23.975586 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5a3cc3ba-e1f6-4050-b71d-9f471113a8e8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:23.981827 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5a3cc3ba-e1f6-4050-b71d-9f471113a8e8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:23.982354 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5a3cc3ba-e1f6-4050-b71d-9f471113a8e8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:23.983363 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5a3cc3ba-e1f6-4050-b71d-9f471113a8e8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:23.984002 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5a3cc3ba-e1f6-4050-b71d-9f471113a8e8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:24.127970 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5a3cc3ba-e1f6-4050-b71d-9f471113a8e8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:24.140931 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5a3cc3ba-e1f6-4050-b71d-9f471113a8e8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:24.143721 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5a3cc3ba-e1f6-4050-b71d-9f471113a8e8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:24.144901 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5a3cc3ba-e1f6-4050-b71d-9f471113a8e8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1740 microversion: 2.20 time: 0.175471 Jan 28 02:07:24.145456 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 416/846] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:23 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:24.975104 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-829fa168-3f19-440e-aede-02ec8e1f090d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:24.976356 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-829fa168-3f19-440e-aede-02ec8e1f090d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:24.982797 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-829fa168-3f19-440e-aede-02ec8e1f090d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:24.988194 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-e1ec3960-1697-4abb-8dba-3aff7d33fb61 req-39506adc-1153-47b7-9ca1-a4e7b82fd63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5b81-d0cd-4833-a177-47b577b84152", "name": "network-vif-plugged", "status": "completed", "tag": "e15e44d6-18a5-424f-9579-7820746bc72a"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:24.989951 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:24.989951 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:07:24.992628 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-829fa168-3f19-440e-aede-02ec8e1f090d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:24.993468 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-829fa168-3f19-440e-aede-02ec8e1f090d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:24.993936 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-829fa168-3f19-440e-aede-02ec8e1f090d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:25.002174 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-e1ec3960-1697-4abb-8dba-3aff7d33fb61 req-39506adc-1153-47b7-9ca1-a4e7b82fd63d service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:25.002618 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-e1ec3960-1697-4abb-8dba-3aff7d33fb61 req-39506adc-1153-47b7-9ca1-a4e7b82fd63d service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:25.014368 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-e1ec3960-1697-4abb-8dba-3aff7d33fb61 req-39506adc-1153-47b7-9ca1-a4e7b82fd63d service nova] Creating event network-vif-plugged:e15e44d6-18a5-424f-9579-7820746bc72a for instance 7cce5b81-d0cd-4833-a177-47b577b84152 on hv-cinder-82497 Jan 28 02:07:25.021427 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-e1ec3960-1697-4abb-8dba-3aff7d33fb61 req-39506adc-1153-47b7-9ca1-a4e7b82fd63d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035968 Jan 28 02:07:25.021884 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 417/847] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:25.027127 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-92dc5054-b820-4c1a-ae44-45fca103f429 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:25.027816 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-92dc5054-b820-4c1a-ae44-45fca103f429 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:25.034386 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-92dc5054-b820-4c1a-ae44-45fca103f429 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:25.034835 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-92dc5054-b820-4c1a-ae44-45fca103f429 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:25.035802 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-92dc5054-b820-4c1a-ae44-45fca103f429 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:25.036265 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-92dc5054-b820-4c1a-ae44-45fca103f429 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:25.214508 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-829fa168-3f19-440e-aede-02ec8e1f090d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:25.219488 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-92dc5054-b820-4c1a-ae44-45fca103f429 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:25.225211 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-829fa168-3f19-440e-aede-02ec8e1f090d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.252984 Jan 28 02:07:25.228284 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-92dc5054-b820-4c1a-ae44-45fca103f429 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1507 microversion: 2.1 time: 0.205118 Jan 28 02:07:25.233823 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 418/848] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:25 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:25.234030 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 431/849] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:24 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:25.244014 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-62b687b6-598e-4784-b4ad-cd9c7dd40494 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:25.244622 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-62b687b6-598e-4784-b4ad-cd9c7dd40494 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:25.249262 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8ac7ffa8-1430-44fe-b0c2-ae9452b4650a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44f90948-6f81-47d8-a235-fce346924812", "device": "/dev/sdb"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:25.252075 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8ac7ffa8-1430-44fe-b0c2-ae9452b4650a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:25.258846 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-62b687b6-598e-4784-b4ad-cd9c7dd40494 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:25.259291 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-62b687b6-598e-4784-b4ad-cd9c7dd40494 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:25.260082 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-62b687b6-598e-4784-b4ad-cd9c7dd40494 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:25.260511 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-62b687b6-598e-4784-b4ad-cd9c7dd40494 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:25.265572 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8ac7ffa8-1430-44fe-b0c2-ae9452b4650a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:25.266464 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8ac7ffa8-1430-44fe-b0c2-ae9452b4650a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:25.268004 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8ac7ffa8-1430-44fe-b0c2-ae9452b4650a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:25.268837 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8ac7ffa8-1430-44fe-b0c2-ae9452b4650a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:25.403063 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-62b687b6-598e-4784-b4ad-cd9c7dd40494 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:25.412360 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-62b687b6-598e-4784-b4ad-cd9c7dd40494 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:25.414511 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-62b687b6-598e-4784-b4ad-cd9c7dd40494 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:25.415928 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-62b687b6-598e-4784-b4ad-cd9c7dd40494 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1740 microversion: 2.20 time: 0.185947 Jan 28 02:07:25.416794 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 419/850] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:25 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:25.578932 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8ac7ffa8-1430-44fe-b0c2-ae9452b4650a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "POST /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336405 Jan 28 02:07:25.580878 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 432/851] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:07:25 2022] POST /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:26.250300 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b4965417-8b15-43e8-a4d4-f16c94a32072 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:26.252322 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b4965417-8b15-43e8-a4d4-f16c94a32072 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:26.258931 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b4965417-8b15-43e8-a4d4-f16c94a32072 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:26.259671 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b4965417-8b15-43e8-a4d4-f16c94a32072 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:26.260813 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b4965417-8b15-43e8-a4d4-f16c94a32072 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:26.261665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b4965417-8b15-43e8-a4d4-f16c94a32072 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:26.407099 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b4965417-8b15-43e8-a4d4-f16c94a32072 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:26.416473 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b4965417-8b15-43e8-a4d4-f16c94a32072 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.171432 Jan 28 02:07:26.417489 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 420/852] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:26 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:26.437757 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0ce5ec19-4de8-4b56-b434-e6f4d3e846ee tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:26.438716 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0ce5ec19-4de8-4b56-b434-e6f4d3e846ee tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:26.447182 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ce5ec19-4de8-4b56-b434-e6f4d3e846ee tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:26.447946 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ce5ec19-4de8-4b56-b434-e6f4d3e846ee tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:26.448936 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ce5ec19-4de8-4b56-b434-e6f4d3e846ee tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:26.450473 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ce5ec19-4de8-4b56-b434-e6f4d3e846ee tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:26.588433 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0ce5ec19-4de8-4b56-b434-e6f4d3e846ee tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:26.597838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0ce5ec19-4de8-4b56-b434-e6f4d3e846ee tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:26.599468 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0ce5ec19-4de8-4b56-b434-e6f4d3e846ee tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:26.600754 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0ce5ec19-4de8-4b56-b434-e6f4d3e846ee tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1740 microversion: 2.20 time: 0.166991 Jan 28 02:07:26.601736 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 433/853] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:26 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:27.435760 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b1d8caa3-17c6-4930-a837-5a59f502ee0e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:27.437008 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b1d8caa3-17c6-4930-a837-5a59f502ee0e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:27.443031 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b1d8caa3-17c6-4930-a837-5a59f502ee0e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.443939 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b1d8caa3-17c6-4930-a837-5a59f502ee0e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.444715 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b1d8caa3-17c6-4930-a837-5a59f502ee0e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.445317 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b1d8caa3-17c6-4930-a837-5a59f502ee0e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.581273 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b1d8caa3-17c6-4930-a837-5a59f502ee0e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:27.588876 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b1d8caa3-17c6-4930-a837-5a59f502ee0e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.156774 Jan 28 02:07:27.599145 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 421/854] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:27 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:27.620764 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-72e11d8c-f6b2-4e48-bb93-facbe5487901 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:27.621648 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-72e11d8c-f6b2-4e48-bb93-facbe5487901 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:27.628188 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-72e11d8c-f6b2-4e48-bb93-facbe5487901 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.628858 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-72e11d8c-f6b2-4e48-bb93-facbe5487901 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.629635 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-72e11d8c-f6b2-4e48-bb93-facbe5487901 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.630101 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-72e11d8c-f6b2-4e48-bb93-facbe5487901 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.786422 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-72e11d8c-f6b2-4e48-bb93-facbe5487901 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:27.795174 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-72e11d8c-f6b2-4e48-bb93-facbe5487901 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:27.796664 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-72e11d8c-f6b2-4e48-bb93-facbe5487901 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:27.798000 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-72e11d8c-f6b2-4e48-bb93-facbe5487901 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1740 microversion: 2.20 time: 0.181043 Jan 28 02:07:27.798585 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 434/855] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:27 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:28.607860 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5d3d7385-92a9-4267-8ae1-f8b1e80522f6 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:28.609272 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5d3d7385-92a9-4267-8ae1-f8b1e80522f6 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:28.616037 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5d3d7385-92a9-4267-8ae1-f8b1e80522f6 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.617003 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5d3d7385-92a9-4267-8ae1-f8b1e80522f6 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.618116 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5d3d7385-92a9-4267-8ae1-f8b1e80522f6 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.619429 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5d3d7385-92a9-4267-8ae1-f8b1e80522f6 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.776491 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5d3d7385-92a9-4267-8ae1-f8b1e80522f6 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:28.786370 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5d3d7385-92a9-4267-8ae1-f8b1e80522f6 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.182544 Jan 28 02:07:28.798048 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 422/856] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:28 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:28.817524 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-df3f6eff-d3c4-406a-a040-6d59728be569 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:28.819264 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-df3f6eff-d3c4-406a-a040-6d59728be569 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:28.828720 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-df3f6eff-d3c4-406a-a040-6d59728be569 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.829455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-df3f6eff-d3c4-406a-a040-6d59728be569 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.830523 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-df3f6eff-d3c4-406a-a040-6d59728be569 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.831745 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-df3f6eff-d3c4-406a-a040-6d59728be569 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.972406 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-df3f6eff-d3c4-406a-a040-6d59728be569 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:28.992916 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-df3f6eff-d3c4-406a-a040-6d59728be569 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:28.994656 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-df3f6eff-d3c4-406a-a040-6d59728be569 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:28.995864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-df3f6eff-d3c4-406a-a040-6d59728be569 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1740 microversion: 2.20 time: 0.183562 Jan 28 02:07:29.007992 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 435/857] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:28 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:07:29.806455 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-df759641-2b4d-40b1-b5c9-781ab0b9a64e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:29.807762 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-df759641-2b4d-40b1-b5c9-781ab0b9a64e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:29.813775 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-df759641-2b4d-40b1-b5c9-781ab0b9a64e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:29.814843 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-df759641-2b4d-40b1-b5c9-781ab0b9a64e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:29.815849 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-df759641-2b4d-40b1-b5c9-781ab0b9a64e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:29.816370 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-df759641-2b4d-40b1-b5c9-781ab0b9a64e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:29.953627 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-df759641-2b4d-40b1-b5c9-781ab0b9a64e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:29.962414 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-df759641-2b4d-40b1-b5c9-781ab0b9a64e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.159540 Jan 28 02:07:29.963165 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 423/858] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:29 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:30.015980 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6ba0eb16-55d8-424b-b201-8e97793c08b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:30.016519 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6ba0eb16-55d8-424b-b201-8e97793c08b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:30.023707 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6ba0eb16-55d8-424b-b201-8e97793c08b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.024159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6ba0eb16-55d8-424b-b201-8e97793c08b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.025005 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6ba0eb16-55d8-424b-b201-8e97793c08b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.025685 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6ba0eb16-55d8-424b-b201-8e97793c08b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.163964 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6ba0eb16-55d8-424b-b201-8e97793c08b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:30.172593 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6ba0eb16-55d8-424b-b201-8e97793c08b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:30.174231 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6ba0eb16-55d8-424b-b201-8e97793c08b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:30.175520 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6ba0eb16-55d8-424b-b201-8e97793c08b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1740 microversion: 2.20 time: 0.163705 Jan 28 02:07:30.186141 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 436/859] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:30 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:30.786957 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-35cce5a0-0a71-4e7d-b52d-bdd0261a485c req-65239fbf-3dca-43cd-b566-a995ab16a2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63f7e8f-3a5e-4636-8231-688a4b068f3a", "name": "network-vif-plugged", "status": "completed", "tag": "862311b2-2f81-451f-a875-dbcc86e8b247"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:30.788532 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:30.788532 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:07:30.796788 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-35cce5a0-0a71-4e7d-b52d-bdd0261a485c req-65239fbf-3dca-43cd-b566-a995ab16a2c7 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.797237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-35cce5a0-0a71-4e7d-b52d-bdd0261a485c req-65239fbf-3dca-43cd-b566-a995ab16a2c7 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.809465 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-35cce5a0-0a71-4e7d-b52d-bdd0261a485c req-65239fbf-3dca-43cd-b566-a995ab16a2c7 service nova] Creating event network-vif-plugged:862311b2-2f81-451f-a875-dbcc86e8b247 for instance e63f7e8f-3a5e-4636-8231-688a4b068f3a on hv-cinder-82497 Jan 28 02:07:30.815385 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-35cce5a0-0a71-4e7d-b52d-bdd0261a485c req-65239fbf-3dca-43cd-b566-a995ab16a2c7 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032033 Jan 28 02:07:30.816117 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 424/860] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:30.979757 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b899703c-3707-472b-8397-2b22f42a6200 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:30.980357 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b899703c-3707-472b-8397-2b22f42a6200 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:30.986908 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b899703c-3707-472b-8397-2b22f42a6200 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.987356 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b899703c-3707-472b-8397-2b22f42a6200 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.988139 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b899703c-3707-472b-8397-2b22f42a6200 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.988572 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b899703c-3707-472b-8397-2b22f42a6200 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:31.110286 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b899703c-3707-472b-8397-2b22f42a6200 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:31.117975 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b899703c-3707-472b-8397-2b22f42a6200 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.141932 Jan 28 02:07:31.118534 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 437/861] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:30 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:31.194944 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ce86d506-da16-41f1-ae6f-df37b79efb10 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:31.195633 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ce86d506-da16-41f1-ae6f-df37b79efb10 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:31.201711 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ce86d506-da16-41f1-ae6f-df37b79efb10 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:31.202115 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ce86d506-da16-41f1-ae6f-df37b79efb10 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:31.202888 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ce86d506-da16-41f1-ae6f-df37b79efb10 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:31.203318 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ce86d506-da16-41f1-ae6f-df37b79efb10 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:31.326862 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ce86d506-da16-41f1-ae6f-df37b79efb10 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:31.334432 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ce86d506-da16-41f1-ae6f-df37b79efb10 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:31.335918 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ce86d506-da16-41f1-ae6f-df37b79efb10 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:31.337060 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ce86d506-da16-41f1-ae6f-df37b79efb10 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1722 microversion: 2.20 time: 0.146429 Jan 28 02:07:31.337610 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 425/862] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:31 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:32.135146 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c8dbf92e-48d3-4995-a90d-4b9735a8a140 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:32.135697 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c8dbf92e-48d3-4995-a90d-4b9735a8a140 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:32.141487 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8dbf92e-48d3-4995-a90d-4b9735a8a140 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:32.141961 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8dbf92e-48d3-4995-a90d-4b9735a8a140 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:32.143216 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8dbf92e-48d3-4995-a90d-4b9735a8a140 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:32.143637 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8dbf92e-48d3-4995-a90d-4b9735a8a140 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:32.270263 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c8dbf92e-48d3-4995-a90d-4b9735a8a140 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:32.282610 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c8dbf92e-48d3-4995-a90d-4b9735a8a140 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1257 microversion: 2.1 time: 0.151048 Jan 28 02:07:32.283554 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 438/863] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:32 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1257 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:32.356459 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9a5df457-6bd8-494e-91ee-c747763409fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:32.357067 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9a5df457-6bd8-494e-91ee-c747763409fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:32.363237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9a5df457-6bd8-494e-91ee-c747763409fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:32.363675 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9a5df457-6bd8-494e-91ee-c747763409fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:32.364448 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9a5df457-6bd8-494e-91ee-c747763409fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:32.364885 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9a5df457-6bd8-494e-91ee-c747763409fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:32.496718 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9a5df457-6bd8-494e-91ee-c747763409fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:32.507655 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9a5df457-6bd8-494e-91ee-c747763409fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:32.509137 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-9a5df457-6bd8-494e-91ee-c747763409fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:32.510307 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9a5df457-6bd8-494e-91ee-c747763409fc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1722 microversion: 2.20 time: 0.159150 Jan 28 02:07:32.510850 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 426/864] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:32 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:33.300318 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a5d0956a-ad10-4733-a5df-174aafb613b3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:33.300946 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a5d0956a-ad10-4733-a5df-174aafb613b3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:33.307050 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a5d0956a-ad10-4733-a5df-174aafb613b3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:33.307490 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a5d0956a-ad10-4733-a5df-174aafb613b3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:33.308323 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a5d0956a-ad10-4733-a5df-174aafb613b3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:33.308750 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a5d0956a-ad10-4733-a5df-174aafb613b3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:33.431203 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a5d0956a-ad10-4733-a5df-174aafb613b3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:33.438524 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a5d0956a-ad10-4733-a5df-174aafb613b3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1441 microversion: 2.1 time: 0.142643 Jan 28 02:07:33.439094 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 439/865] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:33 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1441 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:33.455287 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-30a279ae-0ade-4fbc-b6f4-2f5f41830636 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:33.455932 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-30a279ae-0ade-4fbc-b6f4-2f5f41830636 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:33.461919 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-30a279ae-0ade-4fbc-b6f4-2f5f41830636 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:33.462360 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-30a279ae-0ade-4fbc-b6f4-2f5f41830636 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:33.463117 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-30a279ae-0ade-4fbc-b6f4-2f5f41830636 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:33.463539 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-30a279ae-0ade-4fbc-b6f4-2f5f41830636 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:33.528155 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-de7ae0cd-8b49-4347-9f9b-a1c0da53d4b8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:33.528749 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-de7ae0cd-8b49-4347-9f9b-a1c0da53d4b8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:33.535008 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-de7ae0cd-8b49-4347-9f9b-a1c0da53d4b8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:33.535448 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-de7ae0cd-8b49-4347-9f9b-a1c0da53d4b8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:33.536214 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-de7ae0cd-8b49-4347-9f9b-a1c0da53d4b8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:33.536639 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-de7ae0cd-8b49-4347-9f9b-a1c0da53d4b8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:33.604144 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-30a279ae-0ade-4fbc-b6f4-2f5f41830636 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:33.612168 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-30a279ae-0ade-4fbc-b6f4-2f5f41830636 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1441 microversion: 2.1 time: 0.160396 Jan 28 02:07:33.612168 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 427/866] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:33 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1441 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:33.666354 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-de7ae0cd-8b49-4347-9f9b-a1c0da53d4b8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:33.674301 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-de7ae0cd-8b49-4347-9f9b-a1c0da53d4b8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:33.675801 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-de7ae0cd-8b49-4347-9f9b-a1c0da53d4b8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:33.676963 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-de7ae0cd-8b49-4347-9f9b-a1c0da53d4b8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1722 microversion: 2.20 time: 0.152493 Jan 28 02:07:33.677522 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 440/867] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:33 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:07:34.694401 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-bb03ccda-194e-4a66-bbe4-6548e1ef2edc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:34.695010 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-bb03ccda-194e-4a66-bbe4-6548e1ef2edc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:34.700933 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bb03ccda-194e-4a66-bbe4-6548e1ef2edc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:34.701374 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bb03ccda-194e-4a66-bbe4-6548e1ef2edc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:34.702202 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bb03ccda-194e-4a66-bbe4-6548e1ef2edc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:34.702625 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bb03ccda-194e-4a66-bbe4-6548e1ef2edc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:34.825676 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bb03ccda-194e-4a66-bbe4-6548e1ef2edc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:34.834177 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bb03ccda-194e-4a66-bbe4-6548e1ef2edc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:34.836759 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-bb03ccda-194e-4a66-bbe4-6548e1ef2edc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:34.838961 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-bb03ccda-194e-4a66-bbe4-6548e1ef2edc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1722 microversion: 2.20 time: 0.148254 Jan 28 02:07:34.839905 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 428/868] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:34 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:35.614311 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-b6a2910f-8d23-44bf-95f6-ebb2b12ecc2f req-515a0df4-dfef-4330-b79f-c7c5e57a6eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63f7e8f-3a5e-4636-8231-688a4b068f3a", "tag": "862311b2-2f81-451f-a875-dbcc86e8b247"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:35.616832 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:35.616832 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:07:35.624211 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-b6a2910f-8d23-44bf-95f6-ebb2b12ecc2f req-515a0df4-dfef-4330-b79f-c7c5e57a6eae service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:35.624672 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-b6a2910f-8d23-44bf-95f6-ebb2b12ecc2f req-515a0df4-dfef-4330-b79f-c7c5e57a6eae service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:35.635768 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-b6a2910f-8d23-44bf-95f6-ebb2b12ecc2f req-515a0df4-dfef-4330-b79f-c7c5e57a6eae service nova] Creating event network-changed:862311b2-2f81-451f-a875-dbcc86e8b247 for instance e63f7e8f-3a5e-4636-8231-688a4b068f3a on hv-cinder-82497 Jan 28 02:07:35.640820 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-b6a2910f-8d23-44bf-95f6-ebb2b12ecc2f req-515a0df4-dfef-4330-b79f-c7c5e57a6eae service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030812 Jan 28 02:07:35.641415 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 441/869] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:35.858300 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-55ffb9c5-b51e-4a98-ba71-9513dfd4c11a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:35.858925 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-55ffb9c5-b51e-4a98-ba71-9513dfd4c11a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:35.865050 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-55ffb9c5-b51e-4a98-ba71-9513dfd4c11a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:35.865489 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-55ffb9c5-b51e-4a98-ba71-9513dfd4c11a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:35.866278 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-55ffb9c5-b51e-4a98-ba71-9513dfd4c11a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:35.866703 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-55ffb9c5-b51e-4a98-ba71-9513dfd4c11a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:35.992543 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-55ffb9c5-b51e-4a98-ba71-9513dfd4c11a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:35.997825 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-6ece1184-067a-4127-96b4-60d71623ea6e req-9c44d598-83fa-4229-8aca-204cc9b7a856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5b81-d0cd-4833-a177-47b577b84152", "name": "network-vif-unplugged", "status": "completed", "tag": "e15e44d6-18a5-424f-9579-7820746bc72a"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:35.999401 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:35.999401 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:07:36.002348 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-55ffb9c5-b51e-4a98-ba71-9513dfd4c11a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:36.003851 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-55ffb9c5-b51e-4a98-ba71-9513dfd4c11a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:36.004999 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-55ffb9c5-b51e-4a98-ba71-9513dfd4c11a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1722 microversion: 2.20 time: 0.150487 Jan 28 02:07:36.005548 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 429/870] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:35 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:36.015934 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-6ece1184-067a-4127-96b4-60d71623ea6e req-9c44d598-83fa-4229-8aca-204cc9b7a856 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:36.016394 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-6ece1184-067a-4127-96b4-60d71623ea6e req-9c44d598-83fa-4229-8aca-204cc9b7a856 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:36.028538 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-6ece1184-067a-4127-96b4-60d71623ea6e req-9c44d598-83fa-4229-8aca-204cc9b7a856 service nova] Creating event network-vif-unplugged:e15e44d6-18a5-424f-9579-7820746bc72a for instance 7cce5b81-d0cd-4833-a177-47b577b84152 on hv-cinder-82497 Jan 28 02:07:36.034581 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-6ece1184-067a-4127-96b4-60d71623ea6e req-9c44d598-83fa-4229-8aca-204cc9b7a856 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040624 Jan 28 02:07:36.035313 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 442/871] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:07:37.024645 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-400b44f0-450b-4f8f-9389-da4d3be3cd4b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:37.025272 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-400b44f0-450b-4f8f-9389-da4d3be3cd4b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:37.031712 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-400b44f0-450b-4f8f-9389-da4d3be3cd4b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:37.032262 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-400b44f0-450b-4f8f-9389-da4d3be3cd4b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:37.033121 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-400b44f0-450b-4f8f-9389-da4d3be3cd4b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:37.033589 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-400b44f0-450b-4f8f-9389-da4d3be3cd4b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:37.165997 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-400b44f0-450b-4f8f-9389-da4d3be3cd4b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:37.176988 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-400b44f0-450b-4f8f-9389-da4d3be3cd4b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:37.178529 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-400b44f0-450b-4f8f-9389-da4d3be3cd4b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:37.179751 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-400b44f0-450b-4f8f-9389-da4d3be3cd4b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1722 microversion: 2.20 time: 0.158778 Jan 28 02:07:37.180385 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 430/872] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:37 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:38.199678 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b82d3b02-1abf-4aa8-8fce-7bb97e1652d5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:38.200369 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b82d3b02-1abf-4aa8-8fce-7bb97e1652d5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:38.207252 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b82d3b02-1abf-4aa8-8fce-7bb97e1652d5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.207696 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b82d3b02-1abf-4aa8-8fce-7bb97e1652d5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.208488 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b82d3b02-1abf-4aa8-8fce-7bb97e1652d5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.208920 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b82d3b02-1abf-4aa8-8fce-7bb97e1652d5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.342305 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b82d3b02-1abf-4aa8-8fce-7bb97e1652d5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:38.350787 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b82d3b02-1abf-4aa8-8fce-7bb97e1652d5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:38.352288 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b82d3b02-1abf-4aa8-8fce-7bb97e1652d5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:38.353484 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b82d3b02-1abf-4aa8-8fce-7bb97e1652d5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1665 microversion: 2.20 time: 0.157981 Jan 28 02:07:38.354092 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 443/873] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:38 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:38.371438 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-708f5d67-52f8-40ee-ba5e-55a2291f2339 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29781dbe-1f98-48c1-8c97-0e048cfd0d3a"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:38.372555 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-708f5d67-52f8-40ee-ba5e-55a2291f2339 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:38.379316 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-708f5d67-52f8-40ee-ba5e-55a2291f2339 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.379771 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-708f5d67-52f8-40ee-ba5e-55a2291f2339 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.380559 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-708f5d67-52f8-40ee-ba5e-55a2291f2339 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.380988 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-708f5d67-52f8-40ee-ba5e-55a2291f2339 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.646670 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-708f5d67-52f8-40ee-ba5e-55a2291f2339 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.279109 Jan 28 02:07:38.647272 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 431/874] 10.222.0.77 () {62 vars in 1363 bytes} [Fri Jan 28 02:07:38 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/os-volume_attachments => generated 188 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:38.765167 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a5ba82d0-3e46-4d32-a484-e48511ecbb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:38.765659 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a5ba82d0-3e46-4d32-a484-e48511ecbb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:38.771567 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a5ba82d0-3e46-4d32-a484-e48511ecbb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.772012 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a5ba82d0-3e46-4d32-a484-e48511ecbb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.772777 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a5ba82d0-3e46-4d32-a484-e48511ecbb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.773209 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a5ba82d0-3e46-4d32-a484-e48511ecbb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:40.866254 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a5ba82d0-3e46-4d32-a484-e48511ecbb6f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "DELETE /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/os-volume_attachments/29781dbe-1f98-48c1-8c97-0e048cfd0d3a" status: 202 len: 0 microversion: 2.20 time: 2.104290 Jan 28 02:07:40.866888 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 444/875] 10.222.0.77 () {60 vars in 1456 bytes} [Fri Jan 28 02:07:38 2022] DELETE /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/os-volume_attachments/29781dbe-1f98-48c1-8c97-0e048cfd0d3a => generated 0 bytes in 2106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:07:40.926074 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-fb3177fd-45ba-4e1d-97c5-8c747e2451c2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:40.926638 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-fb3177fd-45ba-4e1d-97c5-8c747e2451c2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:40.933140 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fb3177fd-45ba-4e1d-97c5-8c747e2451c2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:40.933581 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fb3177fd-45ba-4e1d-97c5-8c747e2451c2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:40.934372 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fb3177fd-45ba-4e1d-97c5-8c747e2451c2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:40.934794 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fb3177fd-45ba-4e1d-97c5-8c747e2451c2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:41.022824 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-fb3177fd-45ba-4e1d-97c5-8c747e2451c2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action" status: 202 len: 0 microversion: 2.20 time: 0.101099 Jan 28 02:07:41.023443 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 432/876] 10.222.0.77 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:40 2022] POST /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:07:41.031403 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-97197960-3c5a-45b5-a583-3635a1dc0ccb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:41.032660 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-97197960-3c5a-45b5-a583-3635a1dc0ccb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:41.037842 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-97197960-3c5a-45b5-a583-3635a1dc0ccb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:41.038380 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-97197960-3c5a-45b5-a583-3635a1dc0ccb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:41.039061 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-97197960-3c5a-45b5-a583-3635a1dc0ccb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:41.039495 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-97197960-3c5a-45b5-a583-3635a1dc0ccb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:41.167293 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-97197960-3c5a-45b5-a583-3635a1dc0ccb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:41.176290 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-97197960-3c5a-45b5-a583-3635a1dc0ccb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:41.177879 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-97197960-3c5a-45b5-a583-3635a1dc0ccb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:41.179668 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-97197960-3c5a-45b5-a583-3635a1dc0ccb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1673 microversion: 2.20 time: 0.151572 Jan 28 02:07:41.179858 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 445/877] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:41 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:07:42.198200 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ac09e10d-be01-4e16-84b7-f1b3d474cd13 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:42.198811 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ac09e10d-be01-4e16-84b7-f1b3d474cd13 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:42.205453 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ac09e10d-be01-4e16-84b7-f1b3d474cd13 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:42.206258 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ac09e10d-be01-4e16-84b7-f1b3d474cd13 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:42.207654 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ac09e10d-be01-4e16-84b7-f1b3d474cd13 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:42.208429 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ac09e10d-be01-4e16-84b7-f1b3d474cd13 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:42.334624 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ac09e10d-be01-4e16-84b7-f1b3d474cd13 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:42.342644 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ac09e10d-be01-4e16-84b7-f1b3d474cd13 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:42.344146 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ac09e10d-be01-4e16-84b7-f1b3d474cd13 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:42.345367 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ac09e10d-be01-4e16-84b7-f1b3d474cd13 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.151304 Jan 28 02:07:42.345959 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 433/878] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:42 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:43.364357 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-db5f2683-7897-4914-8805-0151d8eabe07 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:43.365918 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-db5f2683-7897-4914-8805-0151d8eabe07 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:43.373343 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-db5f2683-7897-4914-8805-0151d8eabe07 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:43.374290 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-db5f2683-7897-4914-8805-0151d8eabe07 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:43.375598 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-db5f2683-7897-4914-8805-0151d8eabe07 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:43.376374 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-db5f2683-7897-4914-8805-0151d8eabe07 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:43.500819 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-db5f2683-7897-4914-8805-0151d8eabe07 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:43.509012 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-db5f2683-7897-4914-8805-0151d8eabe07 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:43.510542 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-db5f2683-7897-4914-8805-0151d8eabe07 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:43.511693 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-db5f2683-7897-4914-8805-0151d8eabe07 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.151542 Jan 28 02:07:43.512251 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 446/879] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:43 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:44.531248 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a9aecb85-52e8-425a-a7f9-63f42e3149e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:44.531766 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a9aecb85-52e8-425a-a7f9-63f42e3149e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:44.538105 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a9aecb85-52e8-425a-a7f9-63f42e3149e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.538553 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a9aecb85-52e8-425a-a7f9-63f42e3149e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:44.539297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a9aecb85-52e8-425a-a7f9-63f42e3149e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.539717 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a9aecb85-52e8-425a-a7f9-63f42e3149e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:44.658667 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a9aecb85-52e8-425a-a7f9-63f42e3149e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:44.666378 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a9aecb85-52e8-425a-a7f9-63f42e3149e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:44.667916 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a9aecb85-52e8-425a-a7f9-63f42e3149e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:44.669053 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a9aecb85-52e8-425a-a7f9-63f42e3149e5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.141678 Jan 28 02:07:44.669606 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 434/880] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:44 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:44.932426 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-295650fd-7555-4ff7-854f-ed5f08ef544c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:44.933100 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-295650fd-7555-4ff7-854f-ed5f08ef544c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:44.940050 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-295650fd-7555-4ff7-854f-ed5f08ef544c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.940571 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-295650fd-7555-4ff7-854f-ed5f08ef544c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:44.941419 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-295650fd-7555-4ff7-854f-ed5f08ef544c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.942120 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-295650fd-7555-4ff7-854f-ed5f08ef544c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:45.026474 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-295650fd-7555-4ff7-854f-ed5f08ef544c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lazy-loading 'services' on Instance uuid e849a0fd-94c7-447c-8cbb-3e2f8ff67537 {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:07:45.088687 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-295650fd-7555-4ff7-854f-ed5f08ef544c tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537/os-volume_attachments/44f90948-6f81-47d8-a235-fce346924812" status: 202 len: 0 microversion: 2.1 time: 0.159895 Jan 28 02:07:45.089258 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 447/881] 10.222.0.77 () {58 vars in 1415 bytes} [Fri Jan 28 02:07:44 2022] DELETE /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537/os-volume_attachments/44f90948-6f81-47d8-a235-fce346924812 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:45.687290 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-131bb466-4420-4e6e-b444-1b093c4da0cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:45.687875 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-131bb466-4420-4e6e-b444-1b093c4da0cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:45.693764 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-131bb466-4420-4e6e-b444-1b093c4da0cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:45.694471 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-131bb466-4420-4e6e-b444-1b093c4da0cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:45.695233 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-131bb466-4420-4e6e-b444-1b093c4da0cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:45.695661 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-131bb466-4420-4e6e-b444-1b093c4da0cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:45.825116 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-131bb466-4420-4e6e-b444-1b093c4da0cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:45.835078 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-131bb466-4420-4e6e-b444-1b093c4da0cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:45.836575 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-131bb466-4420-4e6e-b444-1b093c4da0cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:45.838224 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-131bb466-4420-4e6e-b444-1b093c4da0cb tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.154500 Jan 28 02:07:45.838851 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 435/882] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:45 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:46.856732 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-808e1ad8-7125-4329-94d7-0d1728570c0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:46.857430 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-808e1ad8-7125-4329-94d7-0d1728570c0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:46.864124 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-808e1ad8-7125-4329-94d7-0d1728570c0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:46.864575 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-808e1ad8-7125-4329-94d7-0d1728570c0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:46.865342 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-808e1ad8-7125-4329-94d7-0d1728570c0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:46.865803 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-808e1ad8-7125-4329-94d7-0d1728570c0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:46.989501 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-808e1ad8-7125-4329-94d7-0d1728570c0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:46.997247 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-808e1ad8-7125-4329-94d7-0d1728570c0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:46.998883 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-808e1ad8-7125-4329-94d7-0d1728570c0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:47.000030 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-808e1ad8-7125-4329-94d7-0d1728570c0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.147414 Jan 28 02:07:47.000585 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 448/883] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:46 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:48.018863 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-14dd5a70-64ce-4a2b-87ae-0bfa43024a73 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:48.019603 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-14dd5a70-64ce-4a2b-87ae-0bfa43024a73 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:48.025955 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-14dd5a70-64ce-4a2b-87ae-0bfa43024a73 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:48.026392 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-14dd5a70-64ce-4a2b-87ae-0bfa43024a73 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:48.027167 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-14dd5a70-64ce-4a2b-87ae-0bfa43024a73 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:48.027587 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-14dd5a70-64ce-4a2b-87ae-0bfa43024a73 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:48.150756 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-14dd5a70-64ce-4a2b-87ae-0bfa43024a73 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:48.158820 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-14dd5a70-64ce-4a2b-87ae-0bfa43024a73 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:48.160290 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-14dd5a70-64ce-4a2b-87ae-0bfa43024a73 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:48.161417 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-14dd5a70-64ce-4a2b-87ae-0bfa43024a73 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.147117 Jan 28 02:07:48.162006 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 436/884] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:48 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:49.179897 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b3463f0e-437e-4e1d-97f8-7b4030a9f71b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:49.180535 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b3463f0e-437e-4e1d-97f8-7b4030a9f71b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:49.186440 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b3463f0e-437e-4e1d-97f8-7b4030a9f71b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:49.186889 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b3463f0e-437e-4e1d-97f8-7b4030a9f71b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:49.187659 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b3463f0e-437e-4e1d-97f8-7b4030a9f71b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:49.188093 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b3463f0e-437e-4e1d-97f8-7b4030a9f71b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:49.307930 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b3463f0e-437e-4e1d-97f8-7b4030a9f71b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:49.316328 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b3463f0e-437e-4e1d-97f8-7b4030a9f71b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:49.317821 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b3463f0e-437e-4e1d-97f8-7b4030a9f71b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:49.318960 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b3463f0e-437e-4e1d-97f8-7b4030a9f71b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.142846 Jan 28 02:07:49.319776 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 449/885] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:49 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:50.336606 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-53b8729d-eb4a-4b33-984c-51445cfd9412 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:50.337365 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-53b8729d-eb4a-4b33-984c-51445cfd9412 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:50.343744 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-53b8729d-eb4a-4b33-984c-51445cfd9412 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:50.344422 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-53b8729d-eb4a-4b33-984c-51445cfd9412 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:50.345419 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-53b8729d-eb4a-4b33-984c-51445cfd9412 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:50.345885 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-53b8729d-eb4a-4b33-984c-51445cfd9412 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:50.486156 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-53b8729d-eb4a-4b33-984c-51445cfd9412 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:50.504706 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-53b8729d-eb4a-4b33-984c-51445cfd9412 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:50.506534 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-53b8729d-eb4a-4b33-984c-51445cfd9412 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:50.507848 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-53b8729d-eb4a-4b33-984c-51445cfd9412 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.174891 Jan 28 02:07:50.519680 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 437/886] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:50 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:51.526156 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-404529ad-0f77-48c3-a28e-d5760a4a4bb6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:51.526814 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-404529ad-0f77-48c3-a28e-d5760a4a4bb6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:51.533349 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-404529ad-0f77-48c3-a28e-d5760a4a4bb6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:51.533920 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-404529ad-0f77-48c3-a28e-d5760a4a4bb6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:51.534776 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-404529ad-0f77-48c3-a28e-d5760a4a4bb6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:51.535297 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-404529ad-0f77-48c3-a28e-d5760a4a4bb6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:51.669483 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-404529ad-0f77-48c3-a28e-d5760a4a4bb6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:51.677848 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-404529ad-0f77-48c3-a28e-d5760a4a4bb6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:51.679334 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-404529ad-0f77-48c3-a28e-d5760a4a4bb6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:51.680536 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-404529ad-0f77-48c3-a28e-d5760a4a4bb6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.158138 Jan 28 02:07:51.681098 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 450/887] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:51 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:52.699313 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-96efd139-827d-46c5-bfd9-3a1427d321e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:52.699941 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-96efd139-827d-46c5-bfd9-3a1427d321e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:52.706536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-96efd139-827d-46c5-bfd9-3a1427d321e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:52.706980 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-96efd139-827d-46c5-bfd9-3a1427d321e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:52.707744 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-96efd139-827d-46c5-bfd9-3a1427d321e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:52.708172 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-96efd139-827d-46c5-bfd9-3a1427d321e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:52.851525 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-96efd139-827d-46c5-bfd9-3a1427d321e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:52.861312 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-96efd139-827d-46c5-bfd9-3a1427d321e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:52.862925 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-96efd139-827d-46c5-bfd9-3a1427d321e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:52.864246 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-96efd139-827d-46c5-bfd9-3a1427d321e9 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.168534 Jan 28 02:07:52.865030 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 438/888] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:52 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:53.884562 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-23475c9e-722f-453a-aee9-3887b4789127 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:53.885981 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-23475c9e-722f-453a-aee9-3887b4789127 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:53.893461 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-23475c9e-722f-453a-aee9-3887b4789127 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:53.894388 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-23475c9e-722f-453a-aee9-3887b4789127 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:53.895560 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-23475c9e-722f-453a-aee9-3887b4789127 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:53.896225 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-23475c9e-722f-453a-aee9-3887b4789127 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:54.032788 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-23475c9e-722f-453a-aee9-3887b4789127 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:54.043671 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-23475c9e-722f-453a-aee9-3887b4789127 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:54.045921 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-23475c9e-722f-453a-aee9-3887b4789127 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:54.047430 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-23475c9e-722f-453a-aee9-3887b4789127 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.167483 Jan 28 02:07:54.058423 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 451/889] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:53 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:55.065341 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ba70112e-cd3c-4ee5-81d0-8afaccb15f46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:55.066013 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ba70112e-cd3c-4ee5-81d0-8afaccb15f46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:55.071988 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ba70112e-cd3c-4ee5-81d0-8afaccb15f46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:55.072404 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ba70112e-cd3c-4ee5-81d0-8afaccb15f46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:55.073155 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ba70112e-cd3c-4ee5-81d0-8afaccb15f46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:55.073584 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ba70112e-cd3c-4ee5-81d0-8afaccb15f46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:55.200854 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ba70112e-cd3c-4ee5-81d0-8afaccb15f46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:55.210369 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ba70112e-cd3c-4ee5-81d0-8afaccb15f46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:55.211927 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ba70112e-cd3c-4ee5-81d0-8afaccb15f46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:55.213078 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ba70112e-cd3c-4ee5-81d0-8afaccb15f46 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.151440 Jan 28 02:07:55.213639 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 439/890] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:55 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:56.232201 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7a9f5bdd-6b9c-4fb7-932e-f8165bad73c6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:56.232807 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7a9f5bdd-6b9c-4fb7-932e-f8165bad73c6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:56.239264 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7a9f5bdd-6b9c-4fb7-932e-f8165bad73c6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:56.239701 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7a9f5bdd-6b9c-4fb7-932e-f8165bad73c6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:56.240545 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7a9f5bdd-6b9c-4fb7-932e-f8165bad73c6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:56.240971 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7a9f5bdd-6b9c-4fb7-932e-f8165bad73c6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:56.362523 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7a9f5bdd-6b9c-4fb7-932e-f8165bad73c6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:56.370071 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7a9f5bdd-6b9c-4fb7-932e-f8165bad73c6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:56.371571 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7a9f5bdd-6b9c-4fb7-932e-f8165bad73c6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:56.372706 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7a9f5bdd-6b9c-4fb7-932e-f8165bad73c6 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.144555 Jan 28 02:07:56.373256 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 452/891] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:56 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:56.823666 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e48a0ec4-febe-4e45-892b-9aea599d8d0a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:56.824159 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e48a0ec4-febe-4e45-892b-9aea599d8d0a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:56.830484 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e48a0ec4-febe-4e45-892b-9aea599d8d0a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:56.830922 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e48a0ec4-febe-4e45-892b-9aea599d8d0a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:56.831721 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e48a0ec4-febe-4e45-892b-9aea599d8d0a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:56.832142 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e48a0ec4-febe-4e45-892b-9aea599d8d0a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:56.860950 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e48a0ec4-febe-4e45-892b-9aea599d8d0a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:07:56.943669 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-e48a0ec4-febe-4e45-892b-9aea599d8d0a tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 204 len: 0 microversion: 2.1 time: 0.125397 Jan 28 02:07:56.944255 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 440/892] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:07:56 2022] DELETE /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:07:56.955169 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4afccc5b-fab7-492c-94da-6d4ae8880fc2 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:56.955775 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4afccc5b-fab7-492c-94da-6d4ae8880fc2 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:56.961472 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4afccc5b-fab7-492c-94da-6d4ae8880fc2 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:56.961958 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4afccc5b-fab7-492c-94da-6d4ae8880fc2 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:56.962724 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4afccc5b-fab7-492c-94da-6d4ae8880fc2 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:56.963148 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4afccc5b-fab7-492c-94da-6d4ae8880fc2 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:57.085612 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4afccc5b-fab7-492c-94da-6d4ae8880fc2 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:57.092884 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4afccc5b-fab7-492c-94da-6d4ae8880fc2 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1513 microversion: 2.1 time: 0.143812 Jan 28 02:07:57.093455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 453/893] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:56 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:57.391255 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d2962080-143b-4c12-b69a-207935d9bd0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:57.391864 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d2962080-143b-4c12-b69a-207935d9bd0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:57.397676 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d2962080-143b-4c12-b69a-207935d9bd0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:57.398157 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d2962080-143b-4c12-b69a-207935d9bd0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:57.398924 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d2962080-143b-4c12-b69a-207935d9bd0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:57.399357 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d2962080-143b-4c12-b69a-207935d9bd0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:57.518565 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d2962080-143b-4c12-b69a-207935d9bd0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:57.526353 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d2962080-143b-4c12-b69a-207935d9bd0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:57.527840 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d2962080-143b-4c12-b69a-207935d9bd0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:57.528980 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d2962080-143b-4c12-b69a-207935d9bd0d tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.141930 Jan 28 02:07:57.529536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 441/894] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:57 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:58.109698 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-31581c21-7579-482e-927a-30622d9d2ab8 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:58.110366 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-31581c21-7579-482e-927a-30622d9d2ab8 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:58.116760 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-31581c21-7579-482e-927a-30622d9d2ab8 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:58.117198 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-31581c21-7579-482e-927a-30622d9d2ab8 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:58.117980 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-31581c21-7579-482e-927a-30622d9d2ab8 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:58.118405 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-31581c21-7579-482e-927a-30622d9d2ab8 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:58.236144 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-31581c21-7579-482e-927a-30622d9d2ab8 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:58.244007 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-31581c21-7579-482e-927a-30622d9d2ab8 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1513 microversion: 2.1 time: 0.137908 Jan 28 02:07:58.244580 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 454/895] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:58 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1513 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:58.547020 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8cbf243c-adc5-41c6-84d1-b602e3e5ade2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:58.547595 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8cbf243c-adc5-41c6-84d1-b602e3e5ade2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:58.554017 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8cbf243c-adc5-41c6-84d1-b602e3e5ade2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:58.554462 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8cbf243c-adc5-41c6-84d1-b602e3e5ade2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:58.555220 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8cbf243c-adc5-41c6-84d1-b602e3e5ade2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:58.555646 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8cbf243c-adc5-41c6-84d1-b602e3e5ade2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:58.676911 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8cbf243c-adc5-41c6-84d1-b602e3e5ade2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:58.684756 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8cbf243c-adc5-41c6-84d1-b602e3e5ade2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:58.686288 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8cbf243c-adc5-41c6-84d1-b602e3e5ade2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:58.687470 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8cbf243c-adc5-41c6-84d1-b602e3e5ade2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.144247 Jan 28 02:07:58.688023 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 442/896] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:58 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:07:59.260327 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4606be12-0ef6-4def-92f8-63b3c63bc17f tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:59.260963 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4606be12-0ef6-4def-92f8-63b3c63bc17f tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:59.268012 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4606be12-0ef6-4def-92f8-63b3c63bc17f tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:59.268467 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4606be12-0ef6-4def-92f8-63b3c63bc17f tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:59.269284 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4606be12-0ef6-4def-92f8-63b3c63bc17f tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:59.269714 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4606be12-0ef6-4def-92f8-63b3c63bc17f tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:59.398725 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4606be12-0ef6-4def-92f8-63b3c63bc17f tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca9e2035efb4434939b300e1fbe6e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f6ec5f21a4775a393a6e55e34b617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:59.407405 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4606be12-0ef6-4def-92f8-63b3c63bc17f tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 200 len: 1513 microversion: 2.1 time: 0.150654 Jan 28 02:07:59.409789 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 455/897] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:59 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:59.453514 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-0f1aa509-0170-4901-abf1-f984ad25dfc5 req-ef0eb6a9-610f-4599-9c5e-02ac999221fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e849a0fd-94c7-447c-8cbb-3e2f8ff67537", "name": "network-vif-deleted", "tag": "5cec5ab9-7bf7-4dfd-85e2-0e8b712b54e8"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:59.456696 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:59.456696 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:07:59.465330 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-0f1aa509-0170-4901-abf1-f984ad25dfc5 req-ef0eb6a9-610f-4599-9c5e-02ac999221fe service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:59.465784 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-0f1aa509-0170-4901-abf1-f984ad25dfc5 req-ef0eb6a9-610f-4599-9c5e-02ac999221fe service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:59.478233 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-0f1aa509-0170-4901-abf1-f984ad25dfc5 req-ef0eb6a9-610f-4599-9c5e-02ac999221fe service nova] Creating event network-vif-deleted:5cec5ab9-7bf7-4dfd-85e2-0e8b712b54e8 for instance e849a0fd-94c7-447c-8cbb-3e2f8ff67537 on hv-cinder-82497 Jan 28 02:07:59.484506 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-0f1aa509-0170-4901-abf1-f984ad25dfc5 req-ef0eb6a9-610f-4599-9c5e-02ac999221fe service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035774 Jan 28 02:07:59.485787 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 443/898] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:59.706517 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-66e109a7-cf09-450b-8c1d-dbe4464025b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:59.707122 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-66e109a7-cf09-450b-8c1d-dbe4464025b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:59.713064 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-66e109a7-cf09-450b-8c1d-dbe4464025b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:59.713502 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-66e109a7-cf09-450b-8c1d-dbe4464025b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:59.714293 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-66e109a7-cf09-450b-8c1d-dbe4464025b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:59.714723 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-66e109a7-cf09-450b-8c1d-dbe4464025b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:59.833179 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-66e109a7-cf09-450b-8c1d-dbe4464025b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:59.841083 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-66e109a7-cf09-450b-8c1d-dbe4464025b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:59.842615 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-66e109a7-cf09-450b-8c1d-dbe4464025b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:59.843765 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-66e109a7-cf09-450b-8c1d-dbe4464025b3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.141727 Jan 28 02:07:59.844325 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 456/899] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:07:59 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:00.426018 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3492b86d-7b3c-4878-b235-f83620e4ccb4 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:00.426707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3492b86d-7b3c-4878-b235-f83620e4ccb4 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] [instance: e849a0fd-94c7-447c-8cbb-3e2f8ff67537] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:00.432889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3492b86d-7b3c-4878-b235-f83620e4ccb4 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:00.433327 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3492b86d-7b3c-4878-b235-f83620e4ccb4 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:00.434181 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3492b86d-7b3c-4878-b235-f83620e4ccb4 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:00.434601 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3492b86d-7b3c-4878-b235-f83620e4ccb4 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:00.448113 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-3492b86d-7b3c-4878-b235-f83620e4ccb4 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] HTTP exception thrown: Instance e849a0fd-94c7-447c-8cbb-3e2f8ff67537 could not be found. Jan 28 02:08:00.448697 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3492b86d-7b3c-4878-b235-f83620e4ccb4 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] Returning 404 to user: Instance e849a0fd-94c7-447c-8cbb-3e2f8ff67537 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:08:00.449504 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3492b86d-7b3c-4878-b235-f83620e4ccb4 tempest-VolumesSnapshotTestJSON-1747679369 tempest-VolumesSnapshotTestJSON-1747679369-project] 10.222.0.77 "GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537" status: 404 len: 111 microversion: 2.1 time: 0.028780 Jan 28 02:08:00.450063 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 444/900] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:00 2022] GET /compute/v2.1/servers/e849a0fd-94c7-447c-8cbb-3e2f8ff67537 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:08:00.862986 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e51f5aa4-46e9-4d2f-aadc-615934971ef1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:00.863589 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e51f5aa4-46e9-4d2f-aadc-615934971ef1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:00.869256 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e51f5aa4-46e9-4d2f-aadc-615934971ef1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:00.869701 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e51f5aa4-46e9-4d2f-aadc-615934971ef1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:00.870498 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e51f5aa4-46e9-4d2f-aadc-615934971ef1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:00.870925 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e51f5aa4-46e9-4d2f-aadc-615934971ef1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:00.994896 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e51f5aa4-46e9-4d2f-aadc-615934971ef1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:01.002574 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e51f5aa4-46e9-4d2f-aadc-615934971ef1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:01.004069 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e51f5aa4-46e9-4d2f-aadc-615934971ef1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:01.005240 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e51f5aa4-46e9-4d2f-aadc-615934971ef1 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.146660 Jan 28 02:08:01.005818 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 457/901] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:00 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:01.070395 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-56f82b3c-e712-49e7-8acb-9c663da49905 req-4ed8d4ab-6808-4d76-96e5-3070385a1e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5b81-d0cd-4833-a177-47b577b84152", "name": "network-vif-plugged", "status": "completed", "tag": "e15e44d6-18a5-424f-9579-7820746bc72a"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:01.072053 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:08:01.072053 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:08:01.078965 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-56f82b3c-e712-49e7-8acb-9c663da49905 req-4ed8d4ab-6808-4d76-96e5-3070385a1e56 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:01.079435 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-56f82b3c-e712-49e7-8acb-9c663da49905 req-4ed8d4ab-6808-4d76-96e5-3070385a1e56 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:01.090153 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-56f82b3c-e712-49e7-8acb-9c663da49905 req-4ed8d4ab-6808-4d76-96e5-3070385a1e56 service nova] Creating event network-vif-plugged:e15e44d6-18a5-424f-9579-7820746bc72a for instance 7cce5b81-d0cd-4833-a177-47b577b84152 on hv-cinder-82497 Jan 28 02:08:01.095689 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-56f82b3c-e712-49e7-8acb-9c663da49905 req-4ed8d4ab-6808-4d76-96e5-3070385a1e56 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028722 Jan 28 02:08:01.096262 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 445/902] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:02.027785 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-010683b5-b722-4d65-a36f-63dc42ab24b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:02.028303 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-010683b5-b722-4d65-a36f-63dc42ab24b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:02.034149 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-010683b5-b722-4d65-a36f-63dc42ab24b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:02.034593 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-010683b5-b722-4d65-a36f-63dc42ab24b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:02.035357 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-010683b5-b722-4d65-a36f-63dc42ab24b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:02.035787 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-010683b5-b722-4d65-a36f-63dc42ab24b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:02.152072 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-010683b5-b722-4d65-a36f-63dc42ab24b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:02.159742 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-010683b5-b722-4d65-a36f-63dc42ab24b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:02.161226 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-010683b5-b722-4d65-a36f-63dc42ab24b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:02.162392 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-010683b5-b722-4d65-a36f-63dc42ab24b5 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.143322 Jan 28 02:08:02.162949 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 458/903] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:02 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:03.180718 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-94a3a7c3-d6af-4591-9a25-ffe0fba27f0f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:03.181403 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-94a3a7c3-d6af-4591-9a25-ffe0fba27f0f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:03.187525 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-94a3a7c3-d6af-4591-9a25-ffe0fba27f0f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:03.187963 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-94a3a7c3-d6af-4591-9a25-ffe0fba27f0f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:03.189227 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-94a3a7c3-d6af-4591-9a25-ffe0fba27f0f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:03.190047 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-94a3a7c3-d6af-4591-9a25-ffe0fba27f0f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:03.323103 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-94a3a7c3-d6af-4591-9a25-ffe0fba27f0f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:03.331398 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-94a3a7c3-d6af-4591-9a25-ffe0fba27f0f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:03.332880 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-94a3a7c3-d6af-4591-9a25-ffe0fba27f0f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:03.334056 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-94a3a7c3-d6af-4591-9a25-ffe0fba27f0f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.157342 Jan 28 02:08:03.334647 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 446/904] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:03 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:04.352002 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-aedf73da-4f75-4021-b95c-529f730138af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:04.352605 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-aedf73da-4f75-4021-b95c-529f730138af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:04.358365 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aedf73da-4f75-4021-b95c-529f730138af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:04.358806 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aedf73da-4f75-4021-b95c-529f730138af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:04.359568 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aedf73da-4f75-4021-b95c-529f730138af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:04.360000 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aedf73da-4f75-4021-b95c-529f730138af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:04.481458 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-aedf73da-4f75-4021-b95c-529f730138af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:04.489174 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-aedf73da-4f75-4021-b95c-529f730138af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:04.490798 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-aedf73da-4f75-4021-b95c-529f730138af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:04.492025 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-aedf73da-4f75-4021-b95c-529f730138af tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.143748 Jan 28 02:08:04.492573 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 459/905] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:04 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:05.510742 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3c89b0c0-53f7-4d83-94ec-6fea45badbfc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:05.511352 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3c89b0c0-53f7-4d83-94ec-6fea45badbfc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:05.517330 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3c89b0c0-53f7-4d83-94ec-6fea45badbfc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:05.517812 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3c89b0c0-53f7-4d83-94ec-6fea45badbfc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:05.518595 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3c89b0c0-53f7-4d83-94ec-6fea45badbfc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:05.519024 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3c89b0c0-53f7-4d83-94ec-6fea45badbfc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:05.647102 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-3c89b0c0-53f7-4d83-94ec-6fea45badbfc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:05.653667 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-3c89b0c0-53f7-4d83-94ec-6fea45badbfc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:05.655199 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-3c89b0c0-53f7-4d83-94ec-6fea45badbfc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:05.656365 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3c89b0c0-53f7-4d83-94ec-6fea45badbfc tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1731 microversion: 2.20 time: 0.149452 Jan 28 02:08:05.656922 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 447/906] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:05 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:06.676171 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a61f47e6-93d4-44bc-94cd-4c43676eb5e2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:06.676819 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a61f47e6-93d4-44bc-94cd-4c43676eb5e2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:06.682898 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a61f47e6-93d4-44bc-94cd-4c43676eb5e2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:06.683349 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a61f47e6-93d4-44bc-94cd-4c43676eb5e2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:06.684123 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a61f47e6-93d4-44bc-94cd-4c43676eb5e2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:06.684555 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a61f47e6-93d4-44bc-94cd-4c43676eb5e2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:06.812591 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a61f47e6-93d4-44bc-94cd-4c43676eb5e2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:06.821156 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a61f47e6-93d4-44bc-94cd-4c43676eb5e2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:06.822695 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a61f47e6-93d4-44bc-94cd-4c43676eb5e2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:06.823899 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a61f47e6-93d4-44bc-94cd-4c43676eb5e2 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1718 microversion: 2.20 time: 0.152393 Jan 28 02:08:06.824464 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 460/907] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:06 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:36.680952 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-bab33a04-c750-4fa1-9212-be28e7b6262a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:36.681441 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-bab33a04-c750-4fa1-9212-be28e7b6262a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:36.687375 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bab33a04-c750-4fa1-9212-be28e7b6262a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:36.687817 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bab33a04-c750-4fa1-9212-be28e7b6262a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:36.688578 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bab33a04-c750-4fa1-9212-be28e7b6262a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:36.689011 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bab33a04-c750-4fa1-9212-be28e7b6262a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:36.713661 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-bab33a04-c750-4fa1-9212-be28e7b6262a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:08:36.785028 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-bab33a04-c750-4fa1-9212-be28e7b6262a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "DELETE /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 204 len: 0 microversion: 2.1 time: 0.107404 Jan 28 02:08:36.785884 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 448/908] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:08:36 2022] DELETE /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:08:36.793827 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a80eea51-b50a-448c-b3ec-53e8e9752e6e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:36.794423 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a80eea51-b50a-448c-b3ec-53e8e9752e6e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:36.800189 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a80eea51-b50a-448c-b3ec-53e8e9752e6e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:36.800622 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a80eea51-b50a-448c-b3ec-53e8e9752e6e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:36.801380 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a80eea51-b50a-448c-b3ec-53e8e9752e6e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:36.801830 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a80eea51-b50a-448c-b3ec-53e8e9752e6e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:36.923829 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a80eea51-b50a-448c-b3ec-53e8e9752e6e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:36.931219 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a80eea51-b50a-448c-b3ec-53e8e9752e6e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1576 microversion: 2.1 time: 0.141198 Jan 28 02:08:36.931778 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 461/909] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:36 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1576 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:37.949105 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-83c77d0b-986a-4922-9437-fab5f64f2a84 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:37.949807 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-83c77d0b-986a-4922-9437-fab5f64f2a84 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:37.955559 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-83c77d0b-986a-4922-9437-fab5f64f2a84 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:37.956002 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-83c77d0b-986a-4922-9437-fab5f64f2a84 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:37.956749 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-83c77d0b-986a-4922-9437-fab5f64f2a84 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:37.957173 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-83c77d0b-986a-4922-9437-fab5f64f2a84 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:38.086378 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-83c77d0b-986a-4922-9437-fab5f64f2a84 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:38.093594 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-83c77d0b-986a-4922-9437-fab5f64f2a84 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1576 microversion: 2.1 time: 0.148752 Jan 28 02:08:38.094182 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 449/910] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:37 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:39.110340 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-fedf4cbe-1fb3-4223-8b75-e605edd46626 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:39.110925 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-fedf4cbe-1fb3-4223-8b75-e605edd46626 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:39.117237 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fedf4cbe-1fb3-4223-8b75-e605edd46626 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:39.117673 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fedf4cbe-1fb3-4223-8b75-e605edd46626 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:39.118469 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fedf4cbe-1fb3-4223-8b75-e605edd46626 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:39.118902 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-fedf4cbe-1fb3-4223-8b75-e605edd46626 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:39.236508 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-fedf4cbe-1fb3-4223-8b75-e605edd46626 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:39.244519 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-fedf4cbe-1fb3-4223-8b75-e605edd46626 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1576 microversion: 2.1 time: 0.137878 Jan 28 02:08:39.245096 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 462/911] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:39 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1576 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:39.735280 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-6d8d3d9c-af9c-45e6-a984-e8b562c20e6f req-7faf2a7c-e33a-45cc-825f-2b482803ea0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f81333-d5d4-4278-90ed-540420db8271", "name": "network-vif-deleted", "tag": "4143fbb4-bf61-4984-a2ff-d28966a621d6"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:39.737847 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:08:39.737847 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:08:39.744906 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-6d8d3d9c-af9c-45e6-a984-e8b562c20e6f req-7faf2a7c-e33a-45cc-825f-2b482803ea0e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:39.745338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-6d8d3d9c-af9c-45e6-a984-e8b562c20e6f req-7faf2a7c-e33a-45cc-825f-2b482803ea0e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:39.761309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-6d8d3d9c-af9c-45e6-a984-e8b562c20e6f req-7faf2a7c-e33a-45cc-825f-2b482803ea0e service nova] Creating event network-vif-deleted:4143fbb4-bf61-4984-a2ff-d28966a621d6 for instance 96f81333-d5d4-4278-90ed-540420db8271 on hv-cinder-82497 Jan 28 02:08:39.768170 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-6d8d3d9c-af9c-45e6-a984-e8b562c20e6f req-7faf2a7c-e33a-45cc-825f-2b482803ea0e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036791 Jan 28 02:08:39.768775 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 450/912] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:40.261573 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-774b7bb0-d705-4f28-8f43-71dfea8b48aa tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:40.262292 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-774b7bb0-d705-4f28-8f43-71dfea8b48aa tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:40.268207 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-774b7bb0-d705-4f28-8f43-71dfea8b48aa tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:40.268653 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-774b7bb0-d705-4f28-8f43-71dfea8b48aa tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:40.269432 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-774b7bb0-d705-4f28-8f43-71dfea8b48aa tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:40.269902 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-774b7bb0-d705-4f28-8f43-71dfea8b48aa tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:40.300045 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-774b7bb0-d705-4f28-8f43-71dfea8b48aa tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:40.300490 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-774b7bb0-d705-4f28-8f43-71dfea8b48aa tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:40.301418 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-774b7bb0-d705-4f28-8f43-71dfea8b48aa tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lazy-loading 'fault' on Instance uuid 96f81333-d5d4-4278-90ed-540420db8271 {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:08:40.343760 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-774b7bb0-d705-4f28-8f43-71dfea8b48aa tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:40.351110 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-774b7bb0-d705-4f28-8f43-71dfea8b48aa tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 200 len: 1231 microversion: 2.1 time: 0.093316 Jan 28 02:08:40.351684 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 463/913] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:40 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:41.368564 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6b59fffb-66fe-4008-8118-11ae3cf20051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:41.369248 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6b59fffb-66fe-4008-8118-11ae3cf20051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:41.375338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b59fffb-66fe-4008-8118-11ae3cf20051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:41.375776 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b59fffb-66fe-4008-8118-11ae3cf20051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:41.376547 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b59fffb-66fe-4008-8118-11ae3cf20051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:41.376954 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6b59fffb-66fe-4008-8118-11ae3cf20051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:41.390012 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-6b59fffb-66fe-4008-8118-11ae3cf20051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] HTTP exception thrown: Instance 96f81333-d5d4-4278-90ed-540420db8271 could not be found. Jan 28 02:08:41.390575 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6b59fffb-66fe-4008-8118-11ae3cf20051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Returning 404 to user: Instance 96f81333-d5d4-4278-90ed-540420db8271 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:08:41.391362 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6b59fffb-66fe-4008-8118-11ae3cf20051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 404 len: 111 microversion: 2.1 time: 0.026845 Jan 28 02:08:41.391859 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 451/914] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:41 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:08:41.484503 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1569358435", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1346427623", "security_groups": [{"name": "tempest-secgroup-smoke-43440463"}], "block_device_mapping_v2": [{"uuid": "7d5d59e7-b5e2-420d-98e2-bd0e2bf81049", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7946a91b-c87f-479e-b41f-92c9cd8d4828"}]}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:41.596754 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.network.neutron [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] validate_networks() for [('7946a91b-c87f-479e-b41f-92c9cd8d4828', None, None, None, None, None)] {{(pid=115761) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:08:41.990015 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Flavor limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:08:41.990382 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Image limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:08:41.990851 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Flavor pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:08:41.991256 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Image pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:08:41.991663 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:08:42.000912 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:42.001353 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:42.002217 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:42.002647 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:42.018700 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Getting quotas for project d88874e13aa04221b933b43cb2350ad2. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:08:42.022624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Getting quotas for user 44ac16b6ba0c415da52972cda26bbd2d and project d88874e13aa04221b933b43cb2350ad2. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:08:42.083863 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Going to run 1 instances... {{(pid=115761) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:08:42.086085 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d5d59e7-b5e2-420d-98e2-bd0e2bf81049',volume_size=None,volume_type=None)] {{(pid=115761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:08:42.229275 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2ffaf210-e562-4eb8-8e7e-2370d5525779 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.748461 Jan 28 02:08:42.230060 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 464/915] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:08:41 2022] POST /compute/v2.1/servers => generated 404 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 02:08:42.240479 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c89b4596-2d00-4cc7-9c21-8bdb51648746 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:42.241001 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c89b4596-2d00-4cc7-9c21-8bdb51648746 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:42.299272 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c89b4596-2d00-4cc7-9c21-8bdb51648746 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:42.306299 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c89b4596-2d00-4cc7-9c21-8bdb51648746 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1095 microversion: 2.1 time: 0.070103 Jan 28 02:08:42.306869 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 452/916] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:42 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:43.323967 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-49a19b3f-0c3e-4509-a848-0cd1d3037675 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:43.325538 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-49a19b3f-0c3e-4509-a848-0cd1d3037675 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:43.332042 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-49a19b3f-0c3e-4509-a848-0cd1d3037675 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:43.332497 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-49a19b3f-0c3e-4509-a848-0cd1d3037675 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:43.334353 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-49a19b3f-0c3e-4509-a848-0cd1d3037675 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:43.334828 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-49a19b3f-0c3e-4509-a848-0cd1d3037675 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:43.397395 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-49a19b3f-0c3e-4509-a848-0cd1d3037675 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:43.404866 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-49a19b3f-0c3e-4509-a848-0cd1d3037675 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1211 microversion: 2.1 time: 0.084966 Jan 28 02:08:43.405741 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 465/917] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:43 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:44.422521 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2603cc05-ba11-4adb-8b3d-d53548c881c8 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:44.423132 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2603cc05-ba11-4adb-8b3d-d53548c881c8 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:44.430073 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2603cc05-ba11-4adb-8b3d-d53548c881c8 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:44.430603 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2603cc05-ba11-4adb-8b3d-d53548c881c8 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:44.431710 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2603cc05-ba11-4adb-8b3d-d53548c881c8 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:44.432393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2603cc05-ba11-4adb-8b3d-d53548c881c8 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:44.605667 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-2603cc05-ba11-4adb-8b3d-d53548c881c8 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:44.613914 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2603cc05-ba11-4adb-8b3d-d53548c881c8 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1265 microversion: 2.1 time: 0.194501 Jan 28 02:08:44.614613 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 453/918] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:44 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:44.732143 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-f7ad8e2d-6a39-4c46-9c28-fbf717472c2b req-7a0236c4-9649-4fbc-80ce-ebb313928471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4649f96b-6d9f-42e4-899e-806ed1eec112", "tag": "ad3725b6-3af9-47fd-8f63-1d51eba272ca"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:44.734717 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:08:44.734717 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:08:44.743176 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-f7ad8e2d-6a39-4c46-9c28-fbf717472c2b req-7a0236c4-9649-4fbc-80ce-ebb313928471 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:44.743838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-f7ad8e2d-6a39-4c46-9c28-fbf717472c2b req-7a0236c4-9649-4fbc-80ce-ebb313928471 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:44.762590 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-f7ad8e2d-6a39-4c46-9c28-fbf717472c2b req-7a0236c4-9649-4fbc-80ce-ebb313928471 service nova] Creating event network-changed:ad3725b6-3af9-47fd-8f63-1d51eba272ca for instance 4649f96b-6d9f-42e4-899e-806ed1eec112 on hv-cinder-82497 Jan 28 02:08:44.768233 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-f7ad8e2d-6a39-4c46-9c28-fbf717472c2b req-7a0236c4-9649-4fbc-80ce-ebb313928471 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039809 Jan 28 02:08:44.769131 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 466/919] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:45.057455 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-76f7625c-f0fa-4d2d-aaff-c8639bfd620a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:45.058340 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-76f7625c-f0fa-4d2d-aaff-c8639bfd620a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:45.064298 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-76f7625c-f0fa-4d2d-aaff-c8639bfd620a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:45.064743 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-76f7625c-f0fa-4d2d-aaff-c8639bfd620a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.065506 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-76f7625c-f0fa-4d2d-aaff-c8639bfd620a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:45.065979 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-76f7625c-f0fa-4d2d-aaff-c8639bfd620a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.096375 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-76f7625c-f0fa-4d2d-aaff-c8639bfd620a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042825 Jan 28 02:08:45.096945 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 454/920] 10.222.0.77 () {60 vars in 1342 bytes} [Fri Jan 28 02:08:45 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:45.161374 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1186c18a-3bbc-4975-b4fc-01588c57184a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:45.161980 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1186c18a-3bbc-4975-b4fc-01588c57184a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:45.167931 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1186c18a-3bbc-4975-b4fc-01588c57184a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:45.168383 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1186c18a-3bbc-4975-b4fc-01588c57184a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.169155 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1186c18a-3bbc-4975-b4fc-01588c57184a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:45.169591 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1186c18a-3bbc-4975-b4fc-01588c57184a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.194460 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1186c18a-3bbc-4975-b4fc-01588c57184a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Going to try to terminate instance {{(pid=115761) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:08:45.272691 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1186c18a-3bbc-4975-b4fc-01588c57184a tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "DELETE /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 204 len: 0 microversion: 2.20 time: 0.115621 Jan 28 02:08:45.273280 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 467/921] 10.222.0.77 () {60 vars in 1279 bytes} [Fri Jan 28 02:08:45 2022] DELETE /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:08:45.281361 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e979f8df-cefd-4296-a6f5-948f7d1e287f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:45.281983 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e979f8df-cefd-4296-a6f5-948f7d1e287f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:45.288203 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e979f8df-cefd-4296-a6f5-948f7d1e287f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:45.288640 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e979f8df-cefd-4296-a6f5-948f7d1e287f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.289393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e979f8df-cefd-4296-a6f5-948f7d1e287f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:45.289849 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e979f8df-cefd-4296-a6f5-948f7d1e287f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.416672 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-e979f8df-cefd-4296-a6f5-948f7d1e287f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:45.424643 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-e979f8df-cefd-4296-a6f5-948f7d1e287f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:45.426172 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-e979f8df-cefd-4296-a6f5-948f7d1e287f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:45.427339 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-e979f8df-cefd-4296-a6f5-948f7d1e287f tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1724 microversion: 2.20 time: 0.149698 Jan 28 02:08:45.427891 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 455/922] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:45 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:45.631551 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6f1173a0-dc63-4383-bbf2-292bc7625334 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:45.632293 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6f1173a0-dc63-4383-bbf2-292bc7625334 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:45.637986 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6f1173a0-dc63-4383-bbf2-292bc7625334 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:45.638460 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6f1173a0-dc63-4383-bbf2-292bc7625334 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.639268 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6f1173a0-dc63-4383-bbf2-292bc7625334 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:45.639703 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6f1173a0-dc63-4383-bbf2-292bc7625334 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.763631 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6f1173a0-dc63-4383-bbf2-292bc7625334 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:45.771715 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6f1173a0-dc63-4383-bbf2-292bc7625334 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1265 microversion: 2.1 time: 0.144458 Jan 28 02:08:45.772286 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 468/923] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:45 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:46.446805 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ca3d7424-efb9-4d60-af3c-13255810c111 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:46.447384 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ca3d7424-efb9-4d60-af3c-13255810c111 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:46.453473 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ca3d7424-efb9-4d60-af3c-13255810c111 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:46.453942 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ca3d7424-efb9-4d60-af3c-13255810c111 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:46.454700 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ca3d7424-efb9-4d60-af3c-13255810c111 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:46.455123 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ca3d7424-efb9-4d60-af3c-13255810c111 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:46.582222 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ca3d7424-efb9-4d60-af3c-13255810c111 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:46.590042 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ca3d7424-efb9-4d60-af3c-13255810c111 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:46.591543 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-ca3d7424-efb9-4d60-af3c-13255810c111 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:46.592691 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ca3d7424-efb9-4d60-af3c-13255810c111 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1724 microversion: 2.20 time: 0.149862 Jan 28 02:08:46.593250 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 456/924] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:46 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:46.788646 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8f097b42-5735-4ca8-80ae-12f19eafda6a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:46.789267 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8f097b42-5735-4ca8-80ae-12f19eafda6a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:46.795331 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8f097b42-5735-4ca8-80ae-12f19eafda6a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:46.795767 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8f097b42-5735-4ca8-80ae-12f19eafda6a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:46.796534 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8f097b42-5735-4ca8-80ae-12f19eafda6a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:46.796958 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8f097b42-5735-4ca8-80ae-12f19eafda6a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:46.920435 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8f097b42-5735-4ca8-80ae-12f19eafda6a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:46.928412 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8f097b42-5735-4ca8-80ae-12f19eafda6a tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1265 microversion: 2.1 time: 0.143860 Jan 28 02:08:46.928999 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 469/925] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:46 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:47.611573 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-28dcf397-97d6-432c-bf42-56f12751bec0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:47.612240 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-28dcf397-97d6-432c-bf42-56f12751bec0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:47.618811 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-28dcf397-97d6-432c-bf42-56f12751bec0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:47.619270 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-28dcf397-97d6-432c-bf42-56f12751bec0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:47.620051 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-28dcf397-97d6-432c-bf42-56f12751bec0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:47.620485 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-28dcf397-97d6-432c-bf42-56f12751bec0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:47.749683 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-28dcf397-97d6-432c-bf42-56f12751bec0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:47.759990 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-28dcf397-97d6-432c-bf42-56f12751bec0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:47.761502 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-28dcf397-97d6-432c-bf42-56f12751bec0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:47.762694 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-28dcf397-97d6-432c-bf42-56f12751bec0 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1724 microversion: 2.20 time: 0.154898 Jan 28 02:08:47.763248 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 457/926] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:47 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:47.944362 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-04de6d59-0c11-4189-8c51-3286e30a9e39 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:47.945145 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-04de6d59-0c11-4189-8c51-3286e30a9e39 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:47.951494 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-04de6d59-0c11-4189-8c51-3286e30a9e39 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:47.951940 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-04de6d59-0c11-4189-8c51-3286e30a9e39 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:47.952715 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-04de6d59-0c11-4189-8c51-3286e30a9e39 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:47.953147 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-04de6d59-0c11-4189-8c51-3286e30a9e39 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:48.076593 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-04de6d59-0c11-4189-8c51-3286e30a9e39 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:48.084352 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-04de6d59-0c11-4189-8c51-3286e30a9e39 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1265 microversion: 2.1 time: 0.143634 Jan 28 02:08:48.084928 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 470/927] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:47 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:48.246265 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-7e050ed6-3988-4c8d-b945-ac4c6d7f9005 req-b4ed95f4-6370-4b9c-a8e1-f5c6d57600ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5b81-d0cd-4833-a177-47b577b84152", "name": "network-vif-deleted", "tag": "e15e44d6-18a5-424f-9579-7820746bc72a"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:48.248232 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:08:48.248232 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:08:48.257125 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-7e050ed6-3988-4c8d-b945-ac4c6d7f9005 req-b4ed95f4-6370-4b9c-a8e1-f5c6d57600ac service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:48.257565 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-7e050ed6-3988-4c8d-b945-ac4c6d7f9005 req-b4ed95f4-6370-4b9c-a8e1-f5c6d57600ac service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:48.276857 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-7e050ed6-3988-4c8d-b945-ac4c6d7f9005 req-b4ed95f4-6370-4b9c-a8e1-f5c6d57600ac service nova] Creating event network-vif-deleted:e15e44d6-18a5-424f-9579-7820746bc72a for instance 7cce5b81-d0cd-4833-a177-47b577b84152 on hv-cinder-82497 Jan 28 02:08:48.282893 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-7e050ed6-3988-4c8d-b945-ac4c6d7f9005 req-b4ed95f4-6370-4b9c-a8e1-f5c6d57600ac service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040962 Jan 28 02:08:48.283580 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 458/928] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:08:48.780372 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:48.781102 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:48.787096 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:48.787548 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:48.788337 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:48.788772 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:48.825961 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:48.826696 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:48.827149 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lazy-loading 'fault' on Instance uuid 7cce5b81-d0cd-4833-a177-47b577b84152 {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:08:48.869441 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:48.876373 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:48.877921 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264a23388dc64b269325ae52eb4130de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578fc5bd64da4dcdbff2e317361168ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:48.879580 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c1fb573f-9ea9-485d-a789-ae19fb5cb9a8 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 200 len: 1371 microversion: 2.20 time: 0.102553 Jan 28 02:08:48.880140 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 471/929] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:48 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:49.101665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-51df534a-51a1-4619-8a2c-6c94717b0b2b tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:49.102709 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-51df534a-51a1-4619-8a2c-6c94717b0b2b tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:49.109101 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-51df534a-51a1-4619-8a2c-6c94717b0b2b tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:49.109546 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-51df534a-51a1-4619-8a2c-6c94717b0b2b tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:49.110436 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-51df534a-51a1-4619-8a2c-6c94717b0b2b tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:49.110861 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-51df534a-51a1-4619-8a2c-6c94717b0b2b tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:49.245710 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-51df534a-51a1-4619-8a2c-6c94717b0b2b tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:49.253443 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-51df534a-51a1-4619-8a2c-6c94717b0b2b tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1265 microversion: 2.1 time: 0.156578 Jan 28 02:08:49.254113 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 459/930] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:49 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:49.898271 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-cb614713-c2a7-4f59-beee-9bf8137f5bf3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:49.898895 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-cb614713-c2a7-4f59-beee-9bf8137f5bf3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:49.904737 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cb614713-c2a7-4f59-beee-9bf8137f5bf3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:49.905178 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cb614713-c2a7-4f59-beee-9bf8137f5bf3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:49.905981 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cb614713-c2a7-4f59-beee-9bf8137f5bf3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:49.906404 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cb614713-c2a7-4f59-beee-9bf8137f5bf3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:49.919636 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-cb614713-c2a7-4f59-beee-9bf8137f5bf3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] HTTP exception thrown: Instance 7cce5b81-d0cd-4833-a177-47b577b84152 could not be found. Jan 28 02:08:49.920204 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-cb614713-c2a7-4f59-beee-9bf8137f5bf3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Returning 404 to user: Instance 7cce5b81-d0cd-4833-a177-47b577b84152 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:08:49.920998 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-cb614713-c2a7-4f59-beee-9bf8137f5bf3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 404 len: 111 microversion: 2.20 time: 0.026972 Jan 28 02:08:49.921514 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 472/931] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:49 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:08:49.929607 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-71cd414c-3ac3-4b18-ac8f-46e6d35d1f77 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '.version_select at 0x7f08d5e23ee0>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:49.947104 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-71cd414c-3ac3-4b18-ac8f-46e6d35d1f77 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-485075928" status: 204 len: 0 microversion: 2.20 time: 0.021012 Jan 28 02:08:49.947672 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 460/932] 10.222.0.77 () {60 vars in 1258 bytes} [Fri Jan 28 02:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-485075928 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:08:50.271699 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2ac02c5a-f5a6-49ec-b6d0-9290ababaec6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:50.272498 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-2ac02c5a-f5a6-49ec-b6d0-9290ababaec6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:50.279050 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2ac02c5a-f5a6-49ec-b6d0-9290ababaec6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:50.279584 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2ac02c5a-f5a6-49ec-b6d0-9290ababaec6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:50.280369 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2ac02c5a-f5a6-49ec-b6d0-9290ababaec6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:50.280796 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2ac02c5a-f5a6-49ec-b6d0-9290ababaec6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:50.558672 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-2ac02c5a-f5a6-49ec-b6d0-9290ababaec6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:50.565928 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2ac02c5a-f5a6-49ec-b6d0-9290ababaec6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1265 microversion: 2.1 time: 0.298600 Jan 28 02:08:50.566477 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 473/933] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:50 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1265 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:51.583858 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-60105476-5823-44a7-8f9f-29f727c8a992 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:51.584446 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-60105476-5823-44a7-8f9f-29f727c8a992 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:51.590310 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-60105476-5823-44a7-8f9f-29f727c8a992 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:51.590743 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-60105476-5823-44a7-8f9f-29f727c8a992 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:51.591494 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-60105476-5823-44a7-8f9f-29f727c8a992 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:51.591915 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-60105476-5823-44a7-8f9f-29f727c8a992 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:51.711540 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-60105476-5823-44a7-8f9f-29f727c8a992 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:51.718637 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-60105476-5823-44a7-8f9f-29f727c8a992 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1265 microversion: 2.1 time: 0.138984 Jan 28 02:08:51.719197 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 461/934] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:51 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:51.995268 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-be4db94a-381f-46e6-90dc-53cf4f2c3392 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:51.995770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-be4db94a-381f-46e6-90dc-53cf4f2c3392 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:52.001481 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be4db94a-381f-46e6-90dc-53cf4f2c3392 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:52.001961 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be4db94a-381f-46e6-90dc-53cf4f2c3392 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:52.002714 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be4db94a-381f-46e6-90dc-53cf4f2c3392 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:52.003138 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be4db94a-381f-46e6-90dc-53cf4f2c3392 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:52.016432 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-be4db94a-381f-46e6-90dc-53cf4f2c3392 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] HTTP exception thrown: Instance 7cce5b81-d0cd-4833-a177-47b577b84152 could not be found. Jan 28 02:08:52.017003 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-be4db94a-381f-46e6-90dc-53cf4f2c3392 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Returning 404 to user: Instance 7cce5b81-d0cd-4833-a177-47b577b84152 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:08:52.017822 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-be4db94a-381f-46e6-90dc-53cf4f2c3392 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "DELETE /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 404 len: 111 microversion: 2.20 time: 0.026188 Jan 28 02:08:52.018331 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 474/935] 10.222.0.77 () {60 vars in 1279 bytes} [Fri Jan 28 02:08:51 2022] DELETE /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:08:52.026605 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e4e8ff46-a4e9-418b-8a18-7dceba1b5af3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:52.027208 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e4e8ff46-a4e9-418b-8a18-7dceba1b5af3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 7cce5b81-d0cd-4833-a177-47b577b84152] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:52.032898 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e4e8ff46-a4e9-418b-8a18-7dceba1b5af3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:52.033338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e4e8ff46-a4e9-418b-8a18-7dceba1b5af3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:52.034130 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e4e8ff46-a4e9-418b-8a18-7dceba1b5af3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:52.034562 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e4e8ff46-a4e9-418b-8a18-7dceba1b5af3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:52.048239 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-e4e8ff46-a4e9-418b-8a18-7dceba1b5af3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] HTTP exception thrown: Instance 7cce5b81-d0cd-4833-a177-47b577b84152 could not be found. Jan 28 02:08:52.048930 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e4e8ff46-a4e9-418b-8a18-7dceba1b5af3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Returning 404 to user: Instance 7cce5b81-d0cd-4833-a177-47b577b84152 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:08:52.049779 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-e4e8ff46-a4e9-418b-8a18-7dceba1b5af3 tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152" status: 404 len: 111 microversion: 2.20 time: 0.026858 Jan 28 02:08:52.050333 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 462/936] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:52 2022] GET /compute/v2.1/servers/7cce5b81-d0cd-4833-a177-47b577b84152 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:08:52.735437 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7cacdf8c-7c79-4d49-8895-4402455c5d9e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:52.736085 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7cacdf8c-7c79-4d49-8895-4402455c5d9e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:52.742549 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7cacdf8c-7c79-4d49-8895-4402455c5d9e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:52.742987 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7cacdf8c-7c79-4d49-8895-4402455c5d9e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:52.743751 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7cacdf8c-7c79-4d49-8895-4402455c5d9e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:52.744172 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7cacdf8c-7c79-4d49-8895-4402455c5d9e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:52.863354 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7cacdf8c-7c79-4d49-8895-4402455c5d9e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:52.870778 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7cacdf8c-7c79-4d49-8895-4402455c5d9e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1265 microversion: 2.1 time: 0.139275 Jan 28 02:08:52.871343 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 475/937] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:52 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:53.189852 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-adad1a50-3c4e-45dd-a599-59e7aeb7db9b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:53.190438 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-adad1a50-3c4e-45dd-a599-59e7aeb7db9b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:53.197235 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-adad1a50-3c4e-45dd-a599-59e7aeb7db9b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.197679 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-adad1a50-3c4e-45dd-a599-59e7aeb7db9b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.198477 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-adad1a50-3c4e-45dd-a599-59e7aeb7db9b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.198903 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-adad1a50-3c4e-45dd-a599-59e7aeb7db9b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.213013 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-adad1a50-3c4e-45dd-a599-59e7aeb7db9b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] HTTP exception thrown: Instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234 could not be found. Jan 28 02:08:53.213600 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-adad1a50-3c4e-45dd-a599-59e7aeb7db9b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Returning 404 to user: Instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:08:53.214466 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-adad1a50-3c4e-45dd-a599-59e7aeb7db9b tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "DELETE /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 404 len: 111 microversion: 2.20 time: 0.028834 Jan 28 02:08:53.215620 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 463/938] 10.222.0.77 () {60 vars in 1279 bytes} [Fri Jan 28 02:08:53 2022] DELETE /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:08:53.223024 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3e342a5a-164e-45e7-9719-b4d51fbe788e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:53.223727 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3e342a5a-164e-45e7-9719-b4d51fbe788e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] [instance: 9d048580-813a-43b7-ae1a-e0b1a9c8c234] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:53.229350 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3e342a5a-164e-45e7-9719-b4d51fbe788e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.229900 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3e342a5a-164e-45e7-9719-b4d51fbe788e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.230695 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3e342a5a-164e-45e7-9719-b4d51fbe788e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.231129 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3e342a5a-164e-45e7-9719-b4d51fbe788e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.249699 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-3e342a5a-164e-45e7-9719-b4d51fbe788e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] HTTP exception thrown: Instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234 could not be found. Jan 28 02:08:53.250322 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3e342a5a-164e-45e7-9719-b4d51fbe788e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] Returning 404 to user: Instance 9d048580-813a-43b7-ae1a-e0b1a9c8c234 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:08:53.251161 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3e342a5a-164e-45e7-9719-b4d51fbe788e tempest-AttachVolumeShelveTestJSON-236520737 tempest-AttachVolumeShelveTestJSON-236520737-project] 10.222.0.77 "GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234" status: 404 len: 111 microversion: 2.20 time: 0.032065 Jan 28 02:08:53.251922 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 476/939] 10.222.0.77 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:53 2022] GET /compute/v2.1/servers/9d048580-813a-43b7-ae1a-e0b1a9c8c234 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 28 02:08:53.888144 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-38a4ca39-cfa6-4bbe-a24f-4ff4912a6ca5 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:53.888745 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-38a4ca39-cfa6-4bbe-a24f-4ff4912a6ca5 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:53.895475 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-38a4ca39-cfa6-4bbe-a24f-4ff4912a6ca5 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.896243 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-38a4ca39-cfa6-4bbe-a24f-4ff4912a6ca5 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.897207 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-38a4ca39-cfa6-4bbe-a24f-4ff4912a6ca5 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.897824 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-38a4ca39-cfa6-4bbe-a24f-4ff4912a6ca5 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.970533 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:08:53.970793 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: Fri Jan 28 02:08:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:08:54.020748 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-38a4ca39-cfa6-4bbe-a24f-4ff4912a6ca5 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:54.028131 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-38a4ca39-cfa6-4bbe-a24f-4ff4912a6ca5 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1265 microversion: 2.1 time: 0.144190 Jan 28 02:08:54.028891 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 464/940] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:53 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:55.045282 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-18d11206-2679-476a-b4d7-95ba39b78829 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:55.045922 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-18d11206-2679-476a-b4d7-95ba39b78829 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:55.053462 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-18d11206-2679-476a-b4d7-95ba39b78829 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:55.053966 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-18d11206-2679-476a-b4d7-95ba39b78829 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:55.054757 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-18d11206-2679-476a-b4d7-95ba39b78829 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:55.055193 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-18d11206-2679-476a-b4d7-95ba39b78829 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:55.184558 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-18d11206-2679-476a-b4d7-95ba39b78829 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:55.192009 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-18d11206-2679-476a-b4d7-95ba39b78829 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1265 microversion: 2.1 time: 0.150438 Jan 28 02:08:55.193140 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 477/941] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:55 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:55.638821 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-c298b779-09d6-4f13-a9fe-bfd4a5409d61 req-87752df2-23b9-4be4-b5fb-f3a689ccc3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4649f96b-6d9f-42e4-899e-806ed1eec112", "name": "network-vif-plugged", "status": "completed", "tag": "ad3725b6-3af9-47fd-8f63-1d51eba272ca"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:55.640312 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:08:55.640312 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:08:55.649628 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-c298b779-09d6-4f13-a9fe-bfd4a5409d61 req-87752df2-23b9-4be4-b5fb-f3a689ccc3d2 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:55.650101 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-c298b779-09d6-4f13-a9fe-bfd4a5409d61 req-87752df2-23b9-4be4-b5fb-f3a689ccc3d2 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:55.663472 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-c298b779-09d6-4f13-a9fe-bfd4a5409d61 req-87752df2-23b9-4be4-b5fb-f3a689ccc3d2 service nova] Creating event network-vif-plugged:ad3725b6-3af9-47fd-8f63-1d51eba272ca for instance 4649f96b-6d9f-42e4-899e-806ed1eec112 on hv-cinder-82497 Jan 28 02:08:55.668673 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-c298b779-09d6-4f13-a9fe-bfd4a5409d61 req-87752df2-23b9-4be4-b5fb-f3a689ccc3d2 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033578 Jan 28 02:08:55.669473 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 465/942] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:56.210260 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5d6f8346-3aed-41ae-9f5e-cebb53430b7c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:56.210911 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-5d6f8346-3aed-41ae-9f5e-cebb53430b7c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:56.216841 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5d6f8346-3aed-41ae-9f5e-cebb53430b7c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:56.217500 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5d6f8346-3aed-41ae-9f5e-cebb53430b7c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:56.218296 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5d6f8346-3aed-41ae-9f5e-cebb53430b7c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:56.218724 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5d6f8346-3aed-41ae-9f5e-cebb53430b7c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:56.398891 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-5d6f8346-3aed-41ae-9f5e-cebb53430b7c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:56.406250 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-5d6f8346-3aed-41ae-9f5e-cebb53430b7c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1265 microversion: 2.1 time: 0.200298 Jan 28 02:08:56.406734 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 478/943] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:56 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:57.423200 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a9b554c9-02d9-4e50-a88e-730303b32f83 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:57.423890 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a9b554c9-02d9-4e50-a88e-730303b32f83 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:57.430579 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a9b554c9-02d9-4e50-a88e-730303b32f83 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:57.431011 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a9b554c9-02d9-4e50-a88e-730303b32f83 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:57.431781 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a9b554c9-02d9-4e50-a88e-730303b32f83 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:57.432205 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a9b554c9-02d9-4e50-a88e-730303b32f83 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:57.557956 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a9b554c9-02d9-4e50-a88e-730303b32f83 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:57.566395 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a9b554c9-02d9-4e50-a88e-730303b32f83 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1451 microversion: 2.1 time: 0.147233 Jan 28 02:08:57.568833 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 466/944] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:57 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:57.583378 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c7add6f5-b10a-4240-8415-9f9b0fb760a1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:57.584712 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c7add6f5-b10a-4240-8415-9f9b0fb760a1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:57.591360 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c7add6f5-b10a-4240-8415-9f9b0fb760a1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:57.591735 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c7add6f5-b10a-4240-8415-9f9b0fb760a1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:57.592636 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c7add6f5-b10a-4240-8415-9f9b0fb760a1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:57.593142 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c7add6f5-b10a-4240-8415-9f9b0fb760a1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:57.766269 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c7add6f5-b10a-4240-8415-9f9b0fb760a1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:57.773998 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c7add6f5-b10a-4240-8415-9f9b0fb760a1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1451 microversion: 2.1 time: 0.194160 Jan 28 02:08:57.776115 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 479/945] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:57 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1451 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:00.036607 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2ef1d2b0-c1d3-44b9-b1c9-ae484e28f8a0] AMQP server on 10.222.0.77:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 28 02:09:00.050636 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-3a09d9b9-1f3c-42ba-b7fe-18bea4df0375 req-69679ddd-2e13-4931-97ec-826745a7fc97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4649f96b-6d9f-42e4-899e-806ed1eec112", "tag": "ad3725b6-3af9-47fd-8f63-1d51eba272ca"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:00.052795 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:00.052795 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:09:00.064938 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-3a09d9b9-1f3c-42ba-b7fe-18bea4df0375 req-69679ddd-2e13-4931-97ec-826745a7fc97 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:00.065670 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-3a09d9b9-1f3c-42ba-b7fe-18bea4df0375 req-69679ddd-2e13-4931-97ec-826745a7fc97 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:00.080250 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-3a09d9b9-1f3c-42ba-b7fe-18bea4df0375 req-69679ddd-2e13-4931-97ec-826745a7fc97 service nova] Creating event network-changed:ad3725b6-3af9-47fd-8f63-1d51eba272ca for instance 4649f96b-6d9f-42e4-899e-806ed1eec112 on hv-cinder-82497 Jan 28 02:09:00.086269 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-3a09d9b9-1f3c-42ba-b7fe-18bea4df0375 req-69679ddd-2e13-4931-97ec-826745a7fc97 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051489 Jan 28 02:09:00.087660 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 467/946] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:02.809126 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ba9d4cd9-0be9-4b95-bc53-170bc2c060f9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'create', calling method: .version_select at 0x7f08d5c4ad30>, body: {"keypair": {"name": "tempest-keypair-1656210937"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:02.828089 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-ba9d4cd9-0be9-4b95-bc53-170bc2c060f9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Getting quotas for project ad1d1897a9674c6bbcd0e4d1bd0b55ab. Resources: {'key_pairs'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:09:02.832274 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-ba9d4cd9-0be9-4b95-bc53-170bc2c060f9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Getting quotas for user c9d0c28025a44aa3a9f5cfca4d91070c and project ad1d1897a9674c6bbcd0e4d1bd0b55ab. Resources: {'key_pairs'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:09:03.096891 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-ba9d4cd9-0be9-4b95-bc53-170bc2c060f9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Getting quotas for project ad1d1897a9674c6bbcd0e4d1bd0b55ab. Resources: {'key_pairs'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:09:03.100733 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-ba9d4cd9-0be9-4b95-bc53-170bc2c060f9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Getting quotas for user c9d0c28025a44aa3a9f5cfca4d91070c and project ad1d1897a9674c6bbcd0e4d1bd0b55ab. Resources: {'key_pairs'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:09:03.113468 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ba9d4cd9-0be9-4b95-bc53-170bc2c060f9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.421283 Jan 28 02:09:03.114133 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 480/947] 10.222.0.77 () {60 vars in 1157 bytes} [Fri Jan 28 02:09:02 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:04.443978 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-35133040", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3e05f9b-588b-4d48-8a35-7443e06d1f95"}], "security_groups": [{"name": "tempest-securitygroup--415066890"}], "key_name": "tempest-keypair-1656210937", "user_data": "}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:04.464253 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO oslo.messaging._drivers.impl_rabbit [-] [2ef1d2b0-c1d3-44b9-b1c9-ae484e28f8a0] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 39428. Jan 28 02:09:04.560987 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.network.neutron [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] validate_networks() for [('a3e05f9b-588b-4d48-8a35-7443e06d1f95', None, None, None, None, None)] {{(pid=115760) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:09:05.020170 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Flavor limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:09:05.020591 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Image limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:09:05.021064 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Flavor pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:09:05.021473 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Image pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:09:05.021928 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:09:05.032665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:05.033113 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:05.033962 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:05.034402 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:05.055095 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Getting quotas for project ad1d1897a9674c6bbcd0e4d1bd0b55ab. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:09:05.059585 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Getting quotas for user c9d0c28025a44aa3a9f5cfca4d91070c and project ad1d1897a9674c6bbcd0e4d1bd0b55ab. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:09:05.073471 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Going to run 1 instances... {{(pid=115760) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:09:05.078128 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:09:05.155472 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2253ab2d-e187-41bc-842e-516e76cbf9ce tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.719661 Jan 28 02:09:05.156187 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 468/948] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:09:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:09:05.167341 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0b0c9565-fde4-4da2-9eff-9a671af4be28 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:05.167955 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0b0c9565-fde4-4da2-9eff-9a671af4be28 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:05.238554 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0b0c9565-fde4-4da2-9eff-9a671af4be28 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:05.271602 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0b0c9565-fde4-4da2-9eff-9a671af4be28 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1236 microversion: 2.1 time: 0.107904 Jan 28 02:09:05.272869 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 481/949] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:05 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1236 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:06.290115 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4f4fbcbd-c3c4-48a8-849f-50e2649a804e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:06.290838 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4f4fbcbd-c3c4-48a8-849f-50e2649a804e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:06.298367 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4f4fbcbd-c3c4-48a8-849f-50e2649a804e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:06.298982 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4f4fbcbd-c3c4-48a8-849f-50e2649a804e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:06.300834 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4f4fbcbd-c3c4-48a8-849f-50e2649a804e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:06.301412 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4f4fbcbd-c3c4-48a8-849f-50e2649a804e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:06.374118 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-4f4fbcbd-c3c4-48a8-849f-50e2649a804e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:06.382580 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4f4fbcbd-c3c4-48a8-849f-50e2649a804e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1296 microversion: 2.1 time: 0.096835 Jan 28 02:09:06.383163 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 469/950] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:06 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1296 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:07.400791 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-61e1c61d-472e-42b2-9303-bfa8284e465c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:07.402077 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-61e1c61d-472e-42b2-9303-bfa8284e465c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:07.408355 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-61e1c61d-472e-42b2-9303-bfa8284e465c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:07.408976 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-61e1c61d-472e-42b2-9303-bfa8284e465c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:07.409773 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-61e1c61d-472e-42b2-9303-bfa8284e465c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:07.410202 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-61e1c61d-472e-42b2-9303-bfa8284e465c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:07.566869 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-61e1c61d-472e-42b2-9303-bfa8284e465c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:07.576249 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-61e1c61d-472e-42b2-9303-bfa8284e465c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1361 microversion: 2.1 time: 0.180719 Jan 28 02:09:07.577204 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 482/951] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:07 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:07.671574 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-06f0a40d-abfb-4787-bb01-e839dae61919 req-681891ff-162f-4c46-89d9-ba053f7f2555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390009be-47d1-4368-93a3-f95c9c81ef18", "tag": "6ea3818d-ee8e-44a7-954e-2458c4d478d4"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:07.676772 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:07.676772 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:09:07.686184 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-06f0a40d-abfb-4787-bb01-e839dae61919 req-681891ff-162f-4c46-89d9-ba053f7f2555 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:07.686661 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-06f0a40d-abfb-4787-bb01-e839dae61919 req-681891ff-162f-4c46-89d9-ba053f7f2555 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:07.700116 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-06f0a40d-abfb-4787-bb01-e839dae61919 req-681891ff-162f-4c46-89d9-ba053f7f2555 service nova] Creating event network-changed:6ea3818d-ee8e-44a7-954e-2458c4d478d4 for instance 390009be-47d1-4368-93a3-f95c9c81ef18 on hv-cinder-82497 Jan 28 02:09:07.705584 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-06f0a40d-abfb-4787-bb01-e839dae61919 req-681891ff-162f-4c46-89d9-ba053f7f2555 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043163 Jan 28 02:09:07.706933 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 470/952] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:08.594943 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-dc86716b-3c4b-440f-bb6b-b9ec8e749d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:08.595721 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-dc86716b-3c4b-440f-bb6b-b9ec8e749d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:08.603479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc86716b-3c4b-440f-bb6b-b9ec8e749d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:08.603975 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc86716b-3c4b-440f-bb6b-b9ec8e749d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:08.604835 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc86716b-3c4b-440f-bb6b-b9ec8e749d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:08.605269 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-dc86716b-3c4b-440f-bb6b-b9ec8e749d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:08.738959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-dc86716b-3c4b-440f-bb6b-b9ec8e749d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:08.746136 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-dc86716b-3c4b-440f-bb6b-b9ec8e749d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1361 microversion: 2.1 time: 0.155234 Jan 28 02:09:08.746694 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 483/953] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:08 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:09.763173 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-383e0269-f968-4260-9364-e8bbda6e2371 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:09.763852 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-383e0269-f968-4260-9364-e8bbda6e2371 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:09.769936 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-383e0269-f968-4260-9364-e8bbda6e2371 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:09.770378 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-383e0269-f968-4260-9364-e8bbda6e2371 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:09.771142 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-383e0269-f968-4260-9364-e8bbda6e2371 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:09.771579 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-383e0269-f968-4260-9364-e8bbda6e2371 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:09.890054 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-383e0269-f968-4260-9364-e8bbda6e2371 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:09.897461 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-383e0269-f968-4260-9364-e8bbda6e2371 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1361 microversion: 2.1 time: 0.138292 Jan 28 02:09:09.898062 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 471/954] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:09 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1361 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:10.914769 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-36021ca9-19d6-4dc5-8e3b-fc02f4afb896 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:10.915387 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-36021ca9-19d6-4dc5-8e3b-fc02f4afb896 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:10.921312 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-36021ca9-19d6-4dc5-8e3b-fc02f4afb896 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:10.921772 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-36021ca9-19d6-4dc5-8e3b-fc02f4afb896 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:10.922569 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-36021ca9-19d6-4dc5-8e3b-fc02f4afb896 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:10.922998 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-36021ca9-19d6-4dc5-8e3b-fc02f4afb896 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:11.045545 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-36021ca9-19d6-4dc5-8e3b-fc02f4afb896 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:11.053540 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-36021ca9-19d6-4dc5-8e3b-fc02f4afb896 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1361 microversion: 2.1 time: 0.143076 Jan 28 02:09:11.054213 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 484/955] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:10 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1361 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:12.071370 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-302253f5-6157-47fd-a754-08e591e6e9bb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:12.072182 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-302253f5-6157-47fd-a754-08e591e6e9bb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:12.078543 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-302253f5-6157-47fd-a754-08e591e6e9bb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:12.078989 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-302253f5-6157-47fd-a754-08e591e6e9bb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:12.079775 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-302253f5-6157-47fd-a754-08e591e6e9bb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:12.080231 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-302253f5-6157-47fd-a754-08e591e6e9bb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:12.206091 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-302253f5-6157-47fd-a754-08e591e6e9bb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:12.213965 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-302253f5-6157-47fd-a754-08e591e6e9bb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1361 microversion: 2.1 time: 0.147296 Jan 28 02:09:12.214522 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 472/956] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:12 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:13.230781 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d074d998-8cb7-4a24-bbc3-58b27344740a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:13.231392 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d074d998-8cb7-4a24-bbc3-58b27344740a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:13.237184 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d074d998-8cb7-4a24-bbc3-58b27344740a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:13.237632 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d074d998-8cb7-4a24-bbc3-58b27344740a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:13.238446 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d074d998-8cb7-4a24-bbc3-58b27344740a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:13.238893 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d074d998-8cb7-4a24-bbc3-58b27344740a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:13.370778 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-150f6745-9281-4eb3-845e-a41a787f0338 req-f2822734-c033-4266-909a-2ad8813ec55e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390009be-47d1-4368-93a3-f95c9c81ef18", "name": "network-vif-plugged", "status": "completed", "tag": "6ea3818d-ee8e-44a7-954e-2458c4d478d4"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:13.372264 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:13.372264 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:09:13.377380 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d074d998-8cb7-4a24-bbc3-58b27344740a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:13.381144 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-150f6745-9281-4eb3-845e-a41a787f0338 req-f2822734-c033-4266-909a-2ad8813ec55e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:13.382115 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-150f6745-9281-4eb3-845e-a41a787f0338 req-f2822734-c033-4266-909a-2ad8813ec55e service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:13.386473 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d074d998-8cb7-4a24-bbc3-58b27344740a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1361 microversion: 2.1 time: 0.158947 Jan 28 02:09:13.386473 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 485/957] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:13 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:13.401387 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-150f6745-9281-4eb3-845e-a41a787f0338 req-f2822734-c033-4266-909a-2ad8813ec55e service nova] Creating event network-vif-plugged:6ea3818d-ee8e-44a7-954e-2458c4d478d4 for instance 390009be-47d1-4368-93a3-f95c9c81ef18 on hv-cinder-82497 Jan 28 02:09:13.406338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-150f6745-9281-4eb3-845e-a41a787f0338 req-f2822734-c033-4266-909a-2ad8813ec55e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039065 Jan 28 02:09:13.406993 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 473/958] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:09:14.402305 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2d7980a5-3d12-4939-acba-eedc3b7c8ebf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:14.402902 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-2d7980a5-3d12-4939-acba-eedc3b7c8ebf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:14.408813 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2d7980a5-3d12-4939-acba-eedc3b7c8ebf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:14.409265 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2d7980a5-3d12-4939-acba-eedc3b7c8ebf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:14.410087 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2d7980a5-3d12-4939-acba-eedc3b7c8ebf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:14.410520 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2d7980a5-3d12-4939-acba-eedc3b7c8ebf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:14.536788 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-2d7980a5-3d12-4939-acba-eedc3b7c8ebf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:14.544319 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2d7980a5-3d12-4939-acba-eedc3b7c8ebf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1361 microversion: 2.1 time: 0.145623 Jan 28 02:09:14.544886 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 486/959] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:14 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:15.561802 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-964844c2-1bf5-4045-ade5-98a87b4808ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:15.562478 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-964844c2-1bf5-4045-ade5-98a87b4808ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:15.568791 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-964844c2-1bf5-4045-ade5-98a87b4808ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:15.569233 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-964844c2-1bf5-4045-ade5-98a87b4808ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:15.570040 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-964844c2-1bf5-4045-ade5-98a87b4808ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:15.570471 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-964844c2-1bf5-4045-ade5-98a87b4808ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:15.693824 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-964844c2-1bf5-4045-ade5-98a87b4808ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:15.701562 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-964844c2-1bf5-4045-ade5-98a87b4808ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1547 microversion: 2.1 time: 0.143842 Jan 28 02:09:15.702160 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 474/960] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:15 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1547 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:15.718370 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-edc42b1c-c517-45bb-9adf-e56d5ac14a8a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:15.718926 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-edc42b1c-c517-45bb-9adf-e56d5ac14a8a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:15.724860 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-edc42b1c-c517-45bb-9adf-e56d5ac14a8a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:15.725309 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-edc42b1c-c517-45bb-9adf-e56d5ac14a8a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:15.726116 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-edc42b1c-c517-45bb-9adf-e56d5ac14a8a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:15.726549 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-edc42b1c-c517-45bb-9adf-e56d5ac14a8a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:15.804570 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-edc42b1c-c517-45bb-9adf-e56d5ac14a8a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089980 Jan 28 02:09:15.805159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 487/961] 10.222.0.77 () {58 vars in 1274 bytes} [Fri Jan 28 02:09:15 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:16.999814 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8f82e3d3-b178-4c66-aef9-a0f4e40a901f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:17.000748 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8f82e3d3-b178-4c66-aef9-a0f4e40a901f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:17.007028 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f82e3d3-b178-4c66-aef9-a0f4e40a901f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:17.007463 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f82e3d3-b178-4c66-aef9-a0f4e40a901f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:17.008225 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f82e3d3-b178-4c66-aef9-a0f4e40a901f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:17.008649 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f82e3d3-b178-4c66-aef9-a0f4e40a901f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:17.058492 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-db330a3c-d022-44d8-963e-6c389a84d71e req-1615bdd9-1460-41f0-bd12-4312d24e66eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390009be-47d1-4368-93a3-f95c9c81ef18", "tag": "6ea3818d-ee8e-44a7-954e-2458c4d478d4"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:17.059981 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:17.059981 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:09:17.066942 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-db330a3c-d022-44d8-963e-6c389a84d71e req-1615bdd9-1460-41f0-bd12-4312d24e66eb service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:17.067373 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-db330a3c-d022-44d8-963e-6c389a84d71e req-1615bdd9-1460-41f0-bd12-4312d24e66eb service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:17.078757 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-db330a3c-d022-44d8-963e-6c389a84d71e req-1615bdd9-1460-41f0-bd12-4312d24e66eb service nova] Creating event network-changed:6ea3818d-ee8e-44a7-954e-2458c4d478d4 for instance 390009be-47d1-4368-93a3-f95c9c81ef18 on hv-cinder-82497 Jan 28 02:09:17.084382 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-db330a3c-d022-44d8-963e-6c389a84d71e req-1615bdd9-1460-41f0-bd12-4312d24e66eb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086376 Jan 28 02:09:17.085189 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 488/962] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:09:17.144075 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8f82e3d3-b178-4c66-aef9-a0f4e40a901f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 14 microversion: 2.1 time: 0.147995 Jan 28 02:09:17.144710 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 475/963] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:16 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 02:09:18.155980 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5a63b114-1f4a-428d-8355-d3e4db655982 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:18.156978 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-5a63b114-1f4a-428d-8355-d3e4db655982 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:18.164069 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5a63b114-1f4a-428d-8355-d3e4db655982 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:18.164524 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5a63b114-1f4a-428d-8355-d3e4db655982 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:18.165328 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5a63b114-1f4a-428d-8355-d3e4db655982 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:18.165787 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5a63b114-1f4a-428d-8355-d3e4db655982 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:18.250936 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-5a63b114-1f4a-428d-8355-d3e4db655982 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 14 microversion: 2.1 time: 0.098970 Jan 28 02:09:18.251578 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 489/964] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:18 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:09:19.262487 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c6cc8d5e-515c-4cc9-96cb-994274ec18c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:19.263478 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c6cc8d5e-515c-4cc9-96cb-994274ec18c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:19.270553 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c6cc8d5e-515c-4cc9-96cb-994274ec18c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:19.270996 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c6cc8d5e-515c-4cc9-96cb-994274ec18c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:19.271765 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c6cc8d5e-515c-4cc9-96cb-994274ec18c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:19.272257 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c6cc8d5e-515c-4cc9-96cb-994274ec18c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:19.368603 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c6cc8d5e-515c-4cc9-96cb-994274ec18c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 14 microversion: 2.1 time: 0.109794 Jan 28 02:09:19.371578 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 476/965] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:19 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:09:20.379882 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f30cda9a-2dfa-4418-83cb-865a6be10d44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:20.381181 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f30cda9a-2dfa-4418-83cb-865a6be10d44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:20.387481 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f30cda9a-2dfa-4418-83cb-865a6be10d44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:20.387936 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f30cda9a-2dfa-4418-83cb-865a6be10d44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:20.388707 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f30cda9a-2dfa-4418-83cb-865a6be10d44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:20.389142 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f30cda9a-2dfa-4418-83cb-865a6be10d44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:20.489518 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f30cda9a-2dfa-4418-83cb-865a6be10d44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 14 microversion: 2.1 time: 0.112938 Jan 28 02:09:20.490223 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 490/966] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:20 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:09:21.501042 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-90f3f07e-a542-4f9a-85fb-d872372668a4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:21.501971 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-90f3f07e-a542-4f9a-85fb-d872372668a4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:21.509839 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-90f3f07e-a542-4f9a-85fb-d872372668a4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:21.510289 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-90f3f07e-a542-4f9a-85fb-d872372668a4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:21.511058 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-90f3f07e-a542-4f9a-85fb-d872372668a4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:21.511492 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-90f3f07e-a542-4f9a-85fb-d872372668a4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:21.605231 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-90f3f07e-a542-4f9a-85fb-d872372668a4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 14 microversion: 2.1 time: 0.108104 Jan 28 02:09:21.605893 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 477/967] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:21 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:09:22.617226 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d3b478a3-466f-45cd-8a0f-e45f43cb3757 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:22.618200 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d3b478a3-466f-45cd-8a0f-e45f43cb3757 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:22.625093 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d3b478a3-466f-45cd-8a0f-e45f43cb3757 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:22.625806 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d3b478a3-466f-45cd-8a0f-e45f43cb3757 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:22.626319 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d3b478a3-466f-45cd-8a0f-e45f43cb3757 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:22.626744 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d3b478a3-466f-45cd-8a0f-e45f43cb3757 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:22.712004 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d3b478a3-466f-45cd-8a0f-e45f43cb3757 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 14 microversion: 2.1 time: 0.098916 Jan 28 02:09:22.712780 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 491/968] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:22 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:09:23.723995 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f94c8de8-f5de-42c8-bbb4-52c4236b88f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:23.725008 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f94c8de8-f5de-42c8-bbb4-52c4236b88f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:23.733475 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f94c8de8-f5de-42c8-bbb4-52c4236b88f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:23.733956 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f94c8de8-f5de-42c8-bbb4-52c4236b88f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:23.734736 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f94c8de8-f5de-42c8-bbb4-52c4236b88f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:23.735165 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f94c8de8-f5de-42c8-bbb4-52c4236b88f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:23.826620 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f94c8de8-f5de-42c8-bbb4-52c4236b88f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 14 microversion: 2.1 time: 0.107072 Jan 28 02:09:23.827247 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 478/969] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:23 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:09:24.837866 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-48ea210b-4e19-44a9-b781-9b3fe84970b3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:24.838846 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-48ea210b-4e19-44a9-b781-9b3fe84970b3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:24.845364 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-48ea210b-4e19-44a9-b781-9b3fe84970b3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:24.845960 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-48ea210b-4e19-44a9-b781-9b3fe84970b3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:24.846728 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-48ea210b-4e19-44a9-b781-9b3fe84970b3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:24.847154 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-48ea210b-4e19-44a9-b781-9b3fe84970b3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:24.930714 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-48ea210b-4e19-44a9-b781-9b3fe84970b3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 14 microversion: 2.1 time: 0.096666 Jan 28 02:09:24.931388 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 492/970] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:24 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:09:25.943058 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-bf6933f3-dcf4-42ae-9661-d3874ca5af56 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:25.944079 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-bf6933f3-dcf4-42ae-9661-d3874ca5af56 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:25.950820 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bf6933f3-dcf4-42ae-9661-d3874ca5af56 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:25.951266 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bf6933f3-dcf4-42ae-9661-d3874ca5af56 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:25.952036 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bf6933f3-dcf4-42ae-9661-d3874ca5af56 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:25.952471 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-bf6933f3-dcf4-42ae-9661-d3874ca5af56 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:26.037005 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-bf6933f3-dcf4-42ae-9661-d3874ca5af56 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 14 microversion: 2.1 time: 0.098430 Jan 28 02:09:26.037637 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 479/971] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:25 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:09:27.048354 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0a98a828-95d5-4fe7-899f-dcf8600c5456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:27.049341 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0a98a828-95d5-4fe7-899f-dcf8600c5456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:27.055730 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0a98a828-95d5-4fe7-899f-dcf8600c5456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:27.056174 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0a98a828-95d5-4fe7-899f-dcf8600c5456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:27.056940 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0a98a828-95d5-4fe7-899f-dcf8600c5456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:27.057369 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0a98a828-95d5-4fe7-899f-dcf8600c5456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:27.172596 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0a98a828-95d5-4fe7-899f-dcf8600c5456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 14 microversion: 2.1 time: 0.128073 Jan 28 02:09:27.173213 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 493/972] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:27 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:09:28.183175 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-689c9cb1-98cc-4d00-9f09-bf35ebda4f3e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:28.184174 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-689c9cb1-98cc-4d00-9f09-bf35ebda4f3e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:28.190786 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-689c9cb1-98cc-4d00-9f09-bf35ebda4f3e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:28.191234 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-689c9cb1-98cc-4d00-9f09-bf35ebda4f3e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:28.192074 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-689c9cb1-98cc-4d00-9f09-bf35ebda4f3e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:28.192533 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-689c9cb1-98cc-4d00-9f09-bf35ebda4f3e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:28.289489 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-689c9cb1-98cc-4d00-9f09-bf35ebda4f3e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 14 microversion: 2.1 time: 0.109735 Jan 28 02:09:28.290549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 480/973] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:28 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:09:29.301991 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-525c8f4c-7ef2-49f2-b2b2-d247dfe206a8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:29.303009 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-525c8f4c-7ef2-49f2-b2b2-d247dfe206a8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:29.309718 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-525c8f4c-7ef2-49f2-b2b2-d247dfe206a8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:29.310192 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-525c8f4c-7ef2-49f2-b2b2-d247dfe206a8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:29.311208 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-525c8f4c-7ef2-49f2-b2b2-d247dfe206a8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:29.311640 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-525c8f4c-7ef2-49f2-b2b2-d247dfe206a8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:29.402927 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-525c8f4c-7ef2-49f2-b2b2-d247dfe206a8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 7546 microversion: 2.1 time: 0.105438 Jan 28 02:09:29.403597 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 494/974] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:29 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 7546 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:30.417247 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-45a8235a-a900-48e6-a7dd-fc29cffba703 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:30.418730 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-45a8235a-a900-48e6-a7dd-fc29cffba703 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:30.425983 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-45a8235a-a900-48e6-a7dd-fc29cffba703 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:30.426430 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-45a8235a-a900-48e6-a7dd-fc29cffba703 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:30.427204 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-45a8235a-a900-48e6-a7dd-fc29cffba703 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:30.427631 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-45a8235a-a900-48e6-a7dd-fc29cffba703 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:30.523397 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-45a8235a-a900-48e6-a7dd-fc29cffba703 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 15373 microversion: 2.1 time: 0.112047 Jan 28 02:09:30.524422 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 481/975] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:30 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 15373 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:31.536164 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-87401054-a945-41f1-9a6c-25cc53c7c662 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:31.537051 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-87401054-a945-41f1-9a6c-25cc53c7c662 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:31.543442 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-87401054-a945-41f1-9a6c-25cc53c7c662 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:31.543878 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-87401054-a945-41f1-9a6c-25cc53c7c662 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:31.544640 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-87401054-a945-41f1-9a6c-25cc53c7c662 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:31.545063 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-87401054-a945-41f1-9a6c-25cc53c7c662 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:31.647315 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-87401054-a945-41f1-9a6c-25cc53c7c662 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 18305 microversion: 2.1 time: 0.115627 Jan 28 02:09:31.648176 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 495/976] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:31 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 18305 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:32.659296 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b43e208a-2caa-41a3-bddd-5278f8a763cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:32.660205 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b43e208a-2caa-41a3-bddd-5278f8a763cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:32.666649 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b43e208a-2caa-41a3-bddd-5278f8a763cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:32.667102 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b43e208a-2caa-41a3-bddd-5278f8a763cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:32.667869 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b43e208a-2caa-41a3-bddd-5278f8a763cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:32.668297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b43e208a-2caa-41a3-bddd-5278f8a763cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:32.758752 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b43e208a-2caa-41a3-bddd-5278f8a763cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 20193 microversion: 2.1 time: 0.103384 Jan 28 02:09:32.759633 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 482/977] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:32 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 20193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:33.770775 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-32d8ec06-f4b4-40c6-9f1d-91d451bc1f73 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:33.771754 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-32d8ec06-f4b4-40c6-9f1d-91d451bc1f73 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:33.778145 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-32d8ec06-f4b4-40c6-9f1d-91d451bc1f73 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:33.778585 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-32d8ec06-f4b4-40c6-9f1d-91d451bc1f73 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:33.779345 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-32d8ec06-f4b4-40c6-9f1d-91d451bc1f73 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:33.779770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-32d8ec06-f4b4-40c6-9f1d-91d451bc1f73 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:33.894578 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-32d8ec06-f4b4-40c6-9f1d-91d451bc1f73 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 22772 microversion: 2.1 time: 0.127589 Jan 28 02:09:33.895290 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 496/978] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:33 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 22772 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:09:34.906664 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d25b918b-ed3d-43d6-999b-f8e5011802b8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:34.907645 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d25b918b-ed3d-43d6-999b-f8e5011802b8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:34.914908 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d25b918b-ed3d-43d6-999b-f8e5011802b8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:34.915346 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d25b918b-ed3d-43d6-999b-f8e5011802b8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:34.916104 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d25b918b-ed3d-43d6-999b-f8e5011802b8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:34.916603 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d25b918b-ed3d-43d6-999b-f8e5011802b8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:35.011627 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d25b918b-ed3d-43d6-999b-f8e5011802b8 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 23867 microversion: 2.1 time: 0.108843 Jan 28 02:09:35.012247 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 483/979] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:34 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 23867 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:09:36.024469 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-728e10df-da05-47a2-aa3e-ff48532039cf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:36.025460 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-728e10df-da05-47a2-aa3e-ff48532039cf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:36.032098 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-728e10df-da05-47a2-aa3e-ff48532039cf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:36.032539 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-728e10df-da05-47a2-aa3e-ff48532039cf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:36.033318 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-728e10df-da05-47a2-aa3e-ff48532039cf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:36.033741 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-728e10df-da05-47a2-aa3e-ff48532039cf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:36.137127 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-728e10df-da05-47a2-aa3e-ff48532039cf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 25724 microversion: 2.1 time: 0.117099 Jan 28 02:09:36.137786 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 497/980] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:36 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 25724 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:37.150043 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7cc6d302-fe59-463f-8a88-e524ed959c76 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:37.151034 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7cc6d302-fe59-463f-8a88-e524ed959c76 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:37.157614 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7cc6d302-fe59-463f-8a88-e524ed959c76 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:37.158084 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7cc6d302-fe59-463f-8a88-e524ed959c76 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:37.158853 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7cc6d302-fe59-463f-8a88-e524ed959c76 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:37.159278 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7cc6d302-fe59-463f-8a88-e524ed959c76 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:37.257310 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7cc6d302-fe59-463f-8a88-e524ed959c76 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 26928 microversion: 2.1 time: 0.111132 Jan 28 02:09:37.257992 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 484/981] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:37 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 26928 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:38.268996 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-75cce15f-062a-4ca1-9a70-865130a5d435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:38.270009 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-75cce15f-062a-4ca1-9a70-865130a5d435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:38.276468 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-75cce15f-062a-4ca1-9a70-865130a5d435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:38.276910 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-75cce15f-062a-4ca1-9a70-865130a5d435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:38.277680 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-75cce15f-062a-4ca1-9a70-865130a5d435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:38.278146 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-75cce15f-062a-4ca1-9a70-865130a5d435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:38.371977 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-75cce15f-062a-4ca1-9a70-865130a5d435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 27662 microversion: 2.1 time: 0.106860 Jan 28 02:09:38.372645 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 498/982] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:38 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 27662 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:39.384815 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-077d7bf7-0666-4cba-b4dc-52e1e1d911a2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:39.385835 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-077d7bf7-0666-4cba-b4dc-52e1e1d911a2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:39.392379 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-077d7bf7-0666-4cba-b4dc-52e1e1d911a2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:39.392824 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-077d7bf7-0666-4cba-b4dc-52e1e1d911a2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:39.393600 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-077d7bf7-0666-4cba-b4dc-52e1e1d911a2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:39.394065 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-077d7bf7-0666-4cba-b4dc-52e1e1d911a2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:39.494668 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-077d7bf7-0666-4cba-b4dc-52e1e1d911a2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 28067 microversion: 2.1 time: 0.113577 Jan 28 02:09:39.495229 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 485/983] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:39 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 28067 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:40.507417 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-786bbad7-a407-4df2-8b20-e00ca4ca1935 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:40.508424 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-786bbad7-a407-4df2-8b20-e00ca4ca1935 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:40.514903 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-786bbad7-a407-4df2-8b20-e00ca4ca1935 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:40.515343 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-786bbad7-a407-4df2-8b20-e00ca4ca1935 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:40.516101 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-786bbad7-a407-4df2-8b20-e00ca4ca1935 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:40.516526 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-786bbad7-a407-4df2-8b20-e00ca4ca1935 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:40.617993 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-786bbad7-a407-4df2-8b20-e00ca4ca1935 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 28208 microversion: 2.1 time: 0.114749 Jan 28 02:09:40.618548 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 499/984] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:40 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 28208 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:41.629847 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-14c6e73b-51a8-4cd2-bd57-80d5c8235afc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:41.630743 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-14c6e73b-51a8-4cd2-bd57-80d5c8235afc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:41.637152 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-14c6e73b-51a8-4cd2-bd57-80d5c8235afc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:41.637591 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-14c6e73b-51a8-4cd2-bd57-80d5c8235afc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:41.638380 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-14c6e73b-51a8-4cd2-bd57-80d5c8235afc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:41.638809 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-14c6e73b-51a8-4cd2-bd57-80d5c8235afc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:41.737269 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-14c6e73b-51a8-4cd2-bd57-80d5c8235afc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 28438 microversion: 2.1 time: 0.111390 Jan 28 02:09:41.737970 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 486/985] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:41 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 28438 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:42.748520 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-17463eb8-24b3-494c-b792-ba8074d575cb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:42.749527 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-17463eb8-24b3-494c-b792-ba8074d575cb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:42.757308 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-17463eb8-24b3-494c-b792-ba8074d575cb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:42.757771 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-17463eb8-24b3-494c-b792-ba8074d575cb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:42.758979 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-17463eb8-24b3-494c-b792-ba8074d575cb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:42.760014 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-17463eb8-24b3-494c-b792-ba8074d575cb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:42.867146 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-17463eb8-24b3-494c-b792-ba8074d575cb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 28640 microversion: 2.1 time: 0.122441 Jan 28 02:09:42.867792 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 500/986] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:42 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 28640 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:43.880980 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3bd7335f-7d34-4bd0-8774-bf186071190a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:43.882024 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3bd7335f-7d34-4bd0-8774-bf186071190a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:43.890657 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3bd7335f-7d34-4bd0-8774-bf186071190a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:43.891468 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3bd7335f-7d34-4bd0-8774-bf186071190a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:43.892916 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3bd7335f-7d34-4bd0-8774-bf186071190a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:43.893778 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3bd7335f-7d34-4bd0-8774-bf186071190a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:44.007045 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3bd7335f-7d34-4bd0-8774-bf186071190a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 28667 microversion: 2.1 time: 0.130670 Jan 28 02:09:44.007722 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 487/987] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:43 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 28667 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:09:45.022075 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b24ddf41-ba04-4db7-add9-3477af20f435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:45.023078 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b24ddf41-ba04-4db7-add9-3477af20f435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:45.029715 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b24ddf41-ba04-4db7-add9-3477af20f435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:45.030192 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b24ddf41-ba04-4db7-add9-3477af20f435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:45.030971 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b24ddf41-ba04-4db7-add9-3477af20f435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:45.031402 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b24ddf41-ba04-4db7-add9-3477af20f435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:45.122204 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b24ddf41-ba04-4db7-add9-3477af20f435 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 28667 microversion: 2.1 time: 0.104655 Jan 28 02:09:45.122856 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 501/988] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:45 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 28667 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:45.294266 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-0e691fe3-1130-48f8-a35f-b02774bb68f7 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:45.294923 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-0e691fe3-1130-48f8-a35f-b02774bb68f7 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:45.302105 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0e691fe3-1130-48f8-a35f-b02774bb68f7 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:45.302549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0e691fe3-1130-48f8-a35f-b02774bb68f7 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:45.303314 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0e691fe3-1130-48f8-a35f-b02774bb68f7 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:45.303736 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0e691fe3-1130-48f8-a35f-b02774bb68f7 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:45.329595 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.objects.instance [None req-0e691fe3-1130-48f8-a35f-b02774bb68f7 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lazy-loading 'flavor' on Instance uuid e63f7e8f-3a5e-4636-8231-688a4b068f3a {{(pid=115760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:09:45.435249 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-0e691fe3-1130-48f8-a35f-b02774bb68f7 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "POST /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a/action" status: 202 len: 0 microversion: 2.1 time: 0.144318 Jan 28 02:09:45.436320 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 488/989] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:45 2022] POST /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:09:45.451088 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d8f4faea-d3c0-4baf-b27b-32cdebac3cd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:45.452406 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d8f4faea-d3c0-4baf-b27b-32cdebac3cd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:45.464036 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d8f4faea-d3c0-4baf-b27b-32cdebac3cd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:45.464766 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d8f4faea-d3c0-4baf-b27b-32cdebac3cd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:45.466107 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d8f4faea-d3c0-4baf-b27b-32cdebac3cd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:45.466819 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d8f4faea-d3c0-4baf-b27b-32cdebac3cd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:45.606479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d8f4faea-d3c0-4baf-b27b-32cdebac3cd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:45.614747 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d8f4faea-d3c0-4baf-b27b-32cdebac3cd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.171828 Jan 28 02:09:45.615327 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 502/990] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:45 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:46.134773 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-67eab01d-0fae-4e29-bdd2-9dffd57cd052 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:46.136068 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-67eab01d-0fae-4e29-bdd2-9dffd57cd052 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:46.147368 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-67eab01d-0fae-4e29-bdd2-9dffd57cd052 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:46.148084 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-67eab01d-0fae-4e29-bdd2-9dffd57cd052 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:46.149413 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-67eab01d-0fae-4e29-bdd2-9dffd57cd052 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:46.150157 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-67eab01d-0fae-4e29-bdd2-9dffd57cd052 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:46.270271 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-67eab01d-0fae-4e29-bdd2-9dffd57cd052 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 28667 microversion: 2.1 time: 0.138936 Jan 28 02:09:46.271114 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 489/991] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:46 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 28667 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:46.632450 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e7103f05-28f4-49a9-9452-4e3caf370398 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:46.633061 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e7103f05-28f4-49a9-9452-4e3caf370398 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:46.639599 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e7103f05-28f4-49a9-9452-4e3caf370398 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:46.640038 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e7103f05-28f4-49a9-9452-4e3caf370398 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:46.640977 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e7103f05-28f4-49a9-9452-4e3caf370398 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:46.641401 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e7103f05-28f4-49a9-9452-4e3caf370398 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:46.766860 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e7103f05-28f4-49a9-9452-4e3caf370398 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:46.775579 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e7103f05-28f4-49a9-9452-4e3caf370398 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.146833 Jan 28 02:09:46.776168 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 503/992] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:46 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:47.283650 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7a1e6a1d-c2c4-45f7-a5ec-a67796012c52 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:47.284608 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7a1e6a1d-c2c4-45f7-a5ec-a67796012c52 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:47.291553 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7a1e6a1d-c2c4-45f7-a5ec-a67796012c52 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:47.291995 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7a1e6a1d-c2c4-45f7-a5ec-a67796012c52 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:47.292781 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7a1e6a1d-c2c4-45f7-a5ec-a67796012c52 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:47.293270 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7a1e6a1d-c2c4-45f7-a5ec-a67796012c52 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:47.435357 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7a1e6a1d-c2c4-45f7-a5ec-a67796012c52 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 29331 microversion: 2.1 time: 0.155178 Jan 28 02:09:47.436414 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 490/993] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:47 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 29331 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:09:47.792605 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-87115b5f-f171-4ff8-9a0c-f6c3018215fb tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:47.793202 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-87115b5f-f171-4ff8-9a0c-f6c3018215fb tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:47.799304 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-87115b5f-f171-4ff8-9a0c-f6c3018215fb tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:47.799758 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-87115b5f-f171-4ff8-9a0c-f6c3018215fb tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:47.800536 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-87115b5f-f171-4ff8-9a0c-f6c3018215fb tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:47.801657 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-87115b5f-f171-4ff8-9a0c-f6c3018215fb tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:47.929476 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-87115b5f-f171-4ff8-9a0c-f6c3018215fb tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:47.937147 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-87115b5f-f171-4ff8-9a0c-f6c3018215fb tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.148304 Jan 28 02:09:47.937703 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 504/994] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:47 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:48.448702 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ae01e680-722b-4f77-8ac9-22b84c9ecd41 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:48.449692 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ae01e680-722b-4f77-8ac9-22b84c9ecd41 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:48.456428 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ae01e680-722b-4f77-8ac9-22b84c9ecd41 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:48.456871 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ae01e680-722b-4f77-8ac9-22b84c9ecd41 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:48.458173 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ae01e680-722b-4f77-8ac9-22b84c9ecd41 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:48.458606 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ae01e680-722b-4f77-8ac9-22b84c9ecd41 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:48.578828 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ae01e680-722b-4f77-8ac9-22b84c9ecd41 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 30588 microversion: 2.1 time: 0.134164 Jan 28 02:09:48.579398 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 491/995] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:48 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 30588 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:48.954306 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-44093121-d268-4169-8097-20239e299605 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:48.954916 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-44093121-d268-4169-8097-20239e299605 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:48.961946 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-44093121-d268-4169-8097-20239e299605 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:48.962387 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-44093121-d268-4169-8097-20239e299605 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:48.963170 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-44093121-d268-4169-8097-20239e299605 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:48.963599 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-44093121-d268-4169-8097-20239e299605 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:49.091153 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-44093121-d268-4169-8097-20239e299605 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:49.098424 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-44093121-d268-4169-8097-20239e299605 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.147798 Jan 28 02:09:49.098983 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 505/996] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:48 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:49.590835 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-21e8304e-0688-4e0f-9654-44b4385ee9cd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:49.591726 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-21e8304e-0688-4e0f-9654-44b4385ee9cd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:49.598877 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-21e8304e-0688-4e0f-9654-44b4385ee9cd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:49.599432 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-21e8304e-0688-4e0f-9654-44b4385ee9cd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:49.600247 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-21e8304e-0688-4e0f-9654-44b4385ee9cd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:49.600717 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-21e8304e-0688-4e0f-9654-44b4385ee9cd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:49.730307 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-21e8304e-0688-4e0f-9654-44b4385ee9cd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 31692 microversion: 2.1 time: 0.143393 Jan 28 02:09:49.730948 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 492/997] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:49 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 31692 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:50.115282 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c8cb5302-d206-4afc-a3f6-b218679d9125 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:50.115878 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c8cb5302-d206-4afc-a3f6-b218679d9125 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:50.122095 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8cb5302-d206-4afc-a3f6-b218679d9125 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:50.122544 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8cb5302-d206-4afc-a3f6-b218679d9125 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:50.123323 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8cb5302-d206-4afc-a3f6-b218679d9125 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:50.123754 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c8cb5302-d206-4afc-a3f6-b218679d9125 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:50.256263 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c8cb5302-d206-4afc-a3f6-b218679d9125 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:50.263826 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c8cb5302-d206-4afc-a3f6-b218679d9125 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.152209 Jan 28 02:09:50.264389 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 506/998] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:50 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:50.743232 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-04995484-9366-4e75-9079-79e10d72399a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:50.744217 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-04995484-9366-4e75-9079-79e10d72399a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:50.750641 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04995484-9366-4e75-9079-79e10d72399a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:50.751082 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04995484-9366-4e75-9079-79e10d72399a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:50.751849 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04995484-9366-4e75-9079-79e10d72399a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:50.752277 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04995484-9366-4e75-9079-79e10d72399a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:50.860745 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-04995484-9366-4e75-9079-79e10d72399a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 32887 microversion: 2.1 time: 0.121866 Jan 28 02:09:50.861399 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 493/999] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:50 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 32887 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:51.281519 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5a428a4c-be85-4e5c-b9e2-ee6ce4868a78 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:51.282155 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-5a428a4c-be85-4e5c-b9e2-ee6ce4868a78 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:51.288991 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5a428a4c-be85-4e5c-b9e2-ee6ce4868a78 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:51.289434 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5a428a4c-be85-4e5c-b9e2-ee6ce4868a78 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:51.290281 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5a428a4c-be85-4e5c-b9e2-ee6ce4868a78 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:51.290708 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5a428a4c-be85-4e5c-b9e2-ee6ce4868a78 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:51.413516 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-5a428a4c-be85-4e5c-b9e2-ee6ce4868a78 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:51.420968 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-5a428a4c-be85-4e5c-b9e2-ee6ce4868a78 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.143213 Jan 28 02:09:51.421572 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 507/1000] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:51 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:51.874974 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7d3a2023-49ef-4785-a8b1-a4d0099e85a9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:51.875988 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7d3a2023-49ef-4785-a8b1-a4d0099e85a9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:51.883348 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7d3a2023-49ef-4785-a8b1-a4d0099e85a9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:51.883793 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7d3a2023-49ef-4785-a8b1-a4d0099e85a9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:51.884584 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7d3a2023-49ef-4785-a8b1-a4d0099e85a9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:51.885016 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7d3a2023-49ef-4785-a8b1-a4d0099e85a9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:52.009606 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7d3a2023-49ef-4785-a8b1-a4d0099e85a9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 33694 microversion: 2.1 time: 0.139181 Jan 28 02:09:52.010318 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 494/1001] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:51 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 33694 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:52.438674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-5e7af01e-2f4a-4e6d-b71b-2d3afcd779c3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:52.439275 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-5e7af01e-2f4a-4e6d-b71b-2d3afcd779c3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:52.445383 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5e7af01e-2f4a-4e6d-b71b-2d3afcd779c3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:52.445872 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5e7af01e-2f4a-4e6d-b71b-2d3afcd779c3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:52.446666 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5e7af01e-2f4a-4e6d-b71b-2d3afcd779c3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:52.447101 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-5e7af01e-2f4a-4e6d-b71b-2d3afcd779c3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:52.582740 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-5e7af01e-2f4a-4e6d-b71b-2d3afcd779c3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:52.590210 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-5e7af01e-2f4a-4e6d-b71b-2d3afcd779c3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.155313 Jan 28 02:09:52.590777 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 508/1002] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:52 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:53.021997 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-597ea5d4-167f-4f28-8026-38365b2be123 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:53.022998 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-597ea5d4-167f-4f28-8026-38365b2be123 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:53.029984 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-597ea5d4-167f-4f28-8026-38365b2be123 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:53.030437 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-597ea5d4-167f-4f28-8026-38365b2be123 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:53.031227 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-597ea5d4-167f-4f28-8026-38365b2be123 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:53.031665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-597ea5d4-167f-4f28-8026-38365b2be123 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:53.148497 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-597ea5d4-167f-4f28-8026-38365b2be123 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 34683 microversion: 2.1 time: 0.130917 Jan 28 02:09:53.149156 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 495/1003] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:53 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 34683 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:53.608069 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-05f969e4-851a-4d99-ae49-ccd2a7643bd2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:53.608623 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-05f969e4-851a-4d99-ae49-ccd2a7643bd2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:53.615500 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-05f969e4-851a-4d99-ae49-ccd2a7643bd2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:53.615954 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-05f969e4-851a-4d99-ae49-ccd2a7643bd2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:53.616731 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-05f969e4-851a-4d99-ae49-ccd2a7643bd2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:53.617166 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-05f969e4-851a-4d99-ae49-ccd2a7643bd2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:53.751003 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-05f969e4-851a-4d99-ae49-ccd2a7643bd2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:53.764026 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-05f969e4-851a-4d99-ae49-ccd2a7643bd2 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.159395 Jan 28 02:09:53.765000 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 509/1004] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:53 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:54.162679 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-eddb9dec-a732-4a50-baae-626bd573e1d1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:54.164008 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-eddb9dec-a732-4a50-baae-626bd573e1d1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:54.173567 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eddb9dec-a732-4a50-baae-626bd573e1d1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:54.174438 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eddb9dec-a732-4a50-baae-626bd573e1d1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:54.175823 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eddb9dec-a732-4a50-baae-626bd573e1d1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:54.177133 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eddb9dec-a732-4a50-baae-626bd573e1d1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:54.293246 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-eddb9dec-a732-4a50-baae-626bd573e1d1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 35404 microversion: 2.1 time: 0.134510 Jan 28 02:09:54.295076 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 496/1005] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:54 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 35404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:09:54.788356 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4747fa60-c93f-497f-9937-edd6ce583538 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:54.789068 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4747fa60-c93f-497f-9937-edd6ce583538 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:54.796312 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4747fa60-c93f-497f-9937-edd6ce583538 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:54.796763 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4747fa60-c93f-497f-9937-edd6ce583538 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:54.797565 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4747fa60-c93f-497f-9937-edd6ce583538 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:54.798100 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4747fa60-c93f-497f-9937-edd6ce583538 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:54.935433 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4747fa60-c93f-497f-9937-edd6ce583538 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:54.944474 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4747fa60-c93f-497f-9937-edd6ce583538 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.159810 Jan 28 02:09:54.945050 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 510/1006] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:54 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:55.306279 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-80ffb59c-ef56-40d9-b0ef-f2835125e09d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:55.307273 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-80ffb59c-ef56-40d9-b0ef-f2835125e09d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:55.314099 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-80ffb59c-ef56-40d9-b0ef-f2835125e09d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:55.314548 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-80ffb59c-ef56-40d9-b0ef-f2835125e09d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:55.315348 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-80ffb59c-ef56-40d9-b0ef-f2835125e09d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:55.315783 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-80ffb59c-ef56-40d9-b0ef-f2835125e09d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:55.423276 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-80ffb59c-ef56-40d9-b0ef-f2835125e09d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 36670 microversion: 2.1 time: 0.120905 Jan 28 02:09:55.423939 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 497/1007] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:55 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 36670 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:55.962564 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a9796735-dedc-4b39-b365-67273ed0d131 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:55.963169 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a9796735-dedc-4b39-b365-67273ed0d131 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:55.969245 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a9796735-dedc-4b39-b365-67273ed0d131 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:55.969687 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a9796735-dedc-4b39-b365-67273ed0d131 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:55.970503 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a9796735-dedc-4b39-b365-67273ed0d131 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:55.970930 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a9796735-dedc-4b39-b365-67273ed0d131 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:56.104016 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a9796735-dedc-4b39-b365-67273ed0d131 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:56.111839 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a9796735-dedc-4b39-b365-67273ed0d131 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.152952 Jan 28 02:09:56.112476 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 511/1008] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:55 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:56.437519 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-65795829-3624-4fb9-b27f-b31d21ac6d87 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:56.438546 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-65795829-3624-4fb9-b27f-b31d21ac6d87 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:56.445629 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-65795829-3624-4fb9-b27f-b31d21ac6d87 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:56.446102 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-65795829-3624-4fb9-b27f-b31d21ac6d87 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:56.446876 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-65795829-3624-4fb9-b27f-b31d21ac6d87 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:56.447306 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-65795829-3624-4fb9-b27f-b31d21ac6d87 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:56.558593 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-65795829-3624-4fb9-b27f-b31d21ac6d87 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 37893 microversion: 2.1 time: 0.125399 Jan 28 02:09:56.559523 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 498/1009] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:56 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 37893 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:09:57.129334 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-96ac2595-d3b3-4332-87c8-9c99bf94d772 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:57.129937 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-96ac2595-d3b3-4332-87c8-9c99bf94d772 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:57.135793 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-96ac2595-d3b3-4332-87c8-9c99bf94d772 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:57.136236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-96ac2595-d3b3-4332-87c8-9c99bf94d772 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:57.137004 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-96ac2595-d3b3-4332-87c8-9c99bf94d772 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:57.137432 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-96ac2595-d3b3-4332-87c8-9c99bf94d772 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:57.255919 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-96ac2595-d3b3-4332-87c8-9c99bf94d772 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:57.263268 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-96ac2595-d3b3-4332-87c8-9c99bf94d772 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.137666 Jan 28 02:09:57.263829 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 512/1010] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:57 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:57.571186 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d4e6e530-a23c-43c4-a360-0821b4c95e21 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:57.572207 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d4e6e530-a23c-43c4-a360-0821b4c95e21 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:57.578977 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d4e6e530-a23c-43c4-a360-0821b4c95e21 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:57.579424 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d4e6e530-a23c-43c4-a360-0821b4c95e21 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:57.580189 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d4e6e530-a23c-43c4-a360-0821b4c95e21 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:57.580621 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d4e6e530-a23c-43c4-a360-0821b4c95e21 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:57.681864 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d4e6e530-a23c-43c4-a360-0821b4c95e21 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 38186 microversion: 2.1 time: 0.114446 Jan 28 02:09:57.682608 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 499/1011] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:57 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 38186 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:58.280538 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e7861083-af5e-4260-b9f0-3e164d7ee3e3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:58.281137 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e7861083-af5e-4260-b9f0-3e164d7ee3e3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:58.286928 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e7861083-af5e-4260-b9f0-3e164d7ee3e3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:58.287367 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e7861083-af5e-4260-b9f0-3e164d7ee3e3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:58.288121 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e7861083-af5e-4260-b9f0-3e164d7ee3e3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:58.288544 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e7861083-af5e-4260-b9f0-3e164d7ee3e3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:58.414797 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e7861083-af5e-4260-b9f0-3e164d7ee3e3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:58.421927 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e7861083-af5e-4260-b9f0-3e164d7ee3e3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.144950 Jan 28 02:09:58.427414 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 513/1012] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:58 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:58.694795 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-712a64f2-8ffc-4e8f-8c7e-b3e37ae73054 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:58.695857 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-712a64f2-8ffc-4e8f-8c7e-b3e37ae73054 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:58.704161 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-712a64f2-8ffc-4e8f-8c7e-b3e37ae73054 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:58.704627 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-712a64f2-8ffc-4e8f-8c7e-b3e37ae73054 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:58.705390 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-712a64f2-8ffc-4e8f-8c7e-b3e37ae73054 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:58.705840 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-712a64f2-8ffc-4e8f-8c7e-b3e37ae73054 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:58.818114 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-712a64f2-8ffc-4e8f-8c7e-b3e37ae73054 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 38186 microversion: 2.1 time: 0.126972 Jan 28 02:09:58.822486 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 500/1013] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:58 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 38186 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:59.440004 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6ac19d47-0887-40bd-8ae9-c639e6e4f7dc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:59.440633 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6ac19d47-0887-40bd-8ae9-c639e6e4f7dc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:59.447117 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6ac19d47-0887-40bd-8ae9-c639e6e4f7dc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:59.447567 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6ac19d47-0887-40bd-8ae9-c639e6e4f7dc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:59.448601 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6ac19d47-0887-40bd-8ae9-c639e6e4f7dc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:59.449036 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6ac19d47-0887-40bd-8ae9-c639e6e4f7dc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:59.571675 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6ac19d47-0887-40bd-8ae9-c639e6e4f7dc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:59.579412 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6ac19d47-0887-40bd-8ae9-c639e6e4f7dc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1506 microversion: 2.1 time: 0.143053 Jan 28 02:09:59.579984 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 514/1014] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:59 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1506 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:59.599344 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ea5a7a37-ee53-488a-9f59-25e0aa867740 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:59.600375 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ea5a7a37-ee53-488a-9f59-25e0aa867740 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:59.611262 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea5a7a37-ee53-488a-9f59-25e0aa867740 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:59.611995 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea5a7a37-ee53-488a-9f59-25e0aa867740 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:59.613242 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea5a7a37-ee53-488a-9f59-25e0aa867740 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:59.614425 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ea5a7a37-ee53-488a-9f59-25e0aa867740 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:59.710546 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ea5a7a37-ee53-488a-9f59-25e0aa867740 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "POST /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a/action" status: 202 len: 0 microversion: 2.1 time: 0.117794 Jan 28 02:09:59.711243 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 501/1015] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:59 2022] POST /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:09:59.719315 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b236b852-ef6a-4aca-97e3-8ed067ac6d6a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:59.719933 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b236b852-ef6a-4aca-97e3-8ed067ac6d6a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:59.726298 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b236b852-ef6a-4aca-97e3-8ed067ac6d6a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:59.726749 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b236b852-ef6a-4aca-97e3-8ed067ac6d6a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:59.727589 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b236b852-ef6a-4aca-97e3-8ed067ac6d6a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:59.728411 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b236b852-ef6a-4aca-97e3-8ed067ac6d6a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:59.830572 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-47709c80-2c62-4634-be29-b9005f60e48e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:59.832035 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-47709c80-2c62-4634-be29-b9005f60e48e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:59.839258 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-47709c80-2c62-4634-be29-b9005f60e48e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:59.839258 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-47709c80-2c62-4634-be29-b9005f60e48e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:59.839529 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-47709c80-2c62-4634-be29-b9005f60e48e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:59.839954 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-47709c80-2c62-4634-be29-b9005f60e48e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:59.907386 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-b236b852-ef6a-4aca-97e3-8ed067ac6d6a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:59.915456 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b236b852-ef6a-4aca-97e3-8ed067ac6d6a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1514 microversion: 2.1 time: 0.199917 Jan 28 02:09:59.916191 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 515/1016] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:59 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:59.942152 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-47709c80-2c62-4634-be29-b9005f60e48e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 38186 microversion: 2.1 time: 0.115343 Jan 28 02:09:59.942822 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 502/1017] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:59 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 38186 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:10:00.933572 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-80fe5bcf-4220-4646-9f61-5b55e156da5e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:00.934247 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-80fe5bcf-4220-4646-9f61-5b55e156da5e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:00.940936 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-80fe5bcf-4220-4646-9f61-5b55e156da5e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:00.942012 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-80fe5bcf-4220-4646-9f61-5b55e156da5e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:00.942976 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-80fe5bcf-4220-4646-9f61-5b55e156da5e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:00.943406 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-80fe5bcf-4220-4646-9f61-5b55e156da5e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:00.954384 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-eda66c2e-3c4c-4867-b258-18526dddfd44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:00.955372 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-eda66c2e-3c4c-4867-b258-18526dddfd44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:00.963135 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eda66c2e-3c4c-4867-b258-18526dddfd44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:00.963913 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eda66c2e-3c4c-4867-b258-18526dddfd44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:00.964752 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eda66c2e-3c4c-4867-b258-18526dddfd44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:00.965375 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eda66c2e-3c4c-4867-b258-18526dddfd44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:01.081961 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-80fe5bcf-4220-4646-9f61-5b55e156da5e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:01.090027 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-80fe5bcf-4220-4646-9f61-5b55e156da5e tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1516 microversion: 2.1 time: 0.161262 Jan 28 02:10:01.093235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 516/1018] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:00 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:01.093422 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-eda66c2e-3c4c-4867-b258-18526dddfd44 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 200 len: 38313 microversion: 2.1 time: 0.141617 Jan 28 02:10:01.093422 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 503/1019] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:10:00 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 38313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:10:01.102343 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2085f29f-1214-48fa-8549-f637d2f4ea31 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:01.102850 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-2085f29f-1214-48fa-8549-f637d2f4ea31 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:01.108805 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2085f29f-1214-48fa-8549-f637d2f4ea31 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:01.109247 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2085f29f-1214-48fa-8549-f637d2f4ea31 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:01.110043 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2085f29f-1214-48fa-8549-f637d2f4ea31 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:01.110468 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-2085f29f-1214-48fa-8549-f637d2f4ea31 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:01.136552 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2085f29f-1214-48fa-8549-f637d2f4ea31 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/ips" status: 200 len: 146 microversion: 2.1 time: 0.037634 Jan 28 02:10:01.137127 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 517/1020] 10.222.0.77 () {58 vars in 1247 bytes} [Fri Jan 28 02:10:01 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:01.619609 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-2542b12e-4bd6-4f8f-b94b-9927091eaeb0 req-a7e36480-75bf-4d9a-8629-7ab2da6759d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63f7e8f-3a5e-4636-8231-688a4b068f3a", "name": "network-vif-unplugged", "status": "completed", "tag": "862311b2-2f81-451f-a875-dbcc86e8b247"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:01.621314 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:01.621314 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:10:01.629669 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-2542b12e-4bd6-4f8f-b94b-9927091eaeb0 req-a7e36480-75bf-4d9a-8629-7ab2da6759d1 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:01.630134 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-2542b12e-4bd6-4f8f-b94b-9927091eaeb0 req-a7e36480-75bf-4d9a-8629-7ab2da6759d1 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:01.641571 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-2542b12e-4bd6-4f8f-b94b-9927091eaeb0 req-a7e36480-75bf-4d9a-8629-7ab2da6759d1 service nova] Creating event network-vif-unplugged:862311b2-2f81-451f-a875-dbcc86e8b247 for instance e63f7e8f-3a5e-4636-8231-688a4b068f3a on hv-cinder-82497 Jan 28 02:10:01.651735 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-2542b12e-4bd6-4f8f-b94b-9927091eaeb0 req-a7e36480-75bf-4d9a-8629-7ab2da6759d1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030775 Jan 28 02:10:01.652526 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 504/1021] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:02.108348 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a9f0521d-7aa3-44db-817d-a25572d42f9f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:02.108946 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a9f0521d-7aa3-44db-817d-a25572d42f9f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:02.115342 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a9f0521d-7aa3-44db-817d-a25572d42f9f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:02.115787 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a9f0521d-7aa3-44db-817d-a25572d42f9f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:02.116549 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a9f0521d-7aa3-44db-817d-a25572d42f9f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:02.116973 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a9f0521d-7aa3-44db-817d-a25572d42f9f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:02.243770 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a9f0521d-7aa3-44db-817d-a25572d42f9f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:02.251661 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a9f0521d-7aa3-44db-817d-a25572d42f9f tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1572 microversion: 2.1 time: 0.147024 Jan 28 02:10:02.252523 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 518/1022] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:02 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1572 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:03.273187 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5aaf7d2e-e23d-456f-a3a7-0594adefb916 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:03.274498 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5aaf7d2e-e23d-456f-a3a7-0594adefb916 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:03.281602 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5aaf7d2e-e23d-456f-a3a7-0594adefb916 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:03.282081 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5aaf7d2e-e23d-456f-a3a7-0594adefb916 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:03.282863 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5aaf7d2e-e23d-456f-a3a7-0594adefb916 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:03.283294 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5aaf7d2e-e23d-456f-a3a7-0594adefb916 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:03.414644 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-5aaf7d2e-e23d-456f-a3a7-0594adefb916 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:03.422120 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5aaf7d2e-e23d-456f-a3a7-0594adefb916 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1572 microversion: 2.1 time: 0.156159 Jan 28 02:10:03.422697 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 505/1023] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:03 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:03.498931 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3ed46086-d003-42c6-91f5-9e95ae188f58 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b865795c-4c3e-4cda-9522-4eacbd551fbd"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:03.500037 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3ed46086-d003-42c6-91f5-9e95ae188f58 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:03.506054 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3ed46086-d003-42c6-91f5-9e95ae188f58 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:03.506428 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3ed46086-d003-42c6-91f5-9e95ae188f58 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:03.507187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3ed46086-d003-42c6-91f5-9e95ae188f58 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:03.507613 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3ed46086-d003-42c6-91f5-9e95ae188f58 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:03.765666 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3ed46086-d003-42c6-91f5-9e95ae188f58 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270269 Jan 28 02:10:03.766850 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 519/1024] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:10:03 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:04.439458 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a854c98f-65f3-43d5-b308-09d4c5740b5d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:04.440169 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a854c98f-65f3-43d5-b308-09d4c5740b5d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:04.446703 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a854c98f-65f3-43d5-b308-09d4c5740b5d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:04.447146 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a854c98f-65f3-43d5-b308-09d4c5740b5d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:04.448338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a854c98f-65f3-43d5-b308-09d4c5740b5d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:04.448812 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a854c98f-65f3-43d5-b308-09d4c5740b5d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:04.576217 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a854c98f-65f3-43d5-b308-09d4c5740b5d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:04.583612 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a854c98f-65f3-43d5-b308-09d4c5740b5d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1572 microversion: 2.1 time: 0.147807 Jan 28 02:10:04.584166 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 506/1025] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:04 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1572 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:05.601318 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8d0fe199-090c-434b-977d-9f8bad5bb79d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:05.601953 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8d0fe199-090c-434b-977d-9f8bad5bb79d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:05.609317 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d0fe199-090c-434b-977d-9f8bad5bb79d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:05.609785 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d0fe199-090c-434b-977d-9f8bad5bb79d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:05.610570 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d0fe199-090c-434b-977d-9f8bad5bb79d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:05.611009 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8d0fe199-090c-434b-977d-9f8bad5bb79d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:05.730477 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8d0fe199-090c-434b-977d-9f8bad5bb79d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:05.737663 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8d0fe199-090c-434b-977d-9f8bad5bb79d tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1572 microversion: 2.1 time: 0.140500 Jan 28 02:10:05.738761 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 520/1026] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:05 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1572 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:06.755356 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d8adabf2-738a-41cf-9491-74a67e318fcc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:06.755949 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d8adabf2-738a-41cf-9491-74a67e318fcc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:06.762297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d8adabf2-738a-41cf-9491-74a67e318fcc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:06.762732 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d8adabf2-738a-41cf-9491-74a67e318fcc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:06.763496 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d8adabf2-738a-41cf-9491-74a67e318fcc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:06.763927 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d8adabf2-738a-41cf-9491-74a67e318fcc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:06.896530 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-d8adabf2-738a-41cf-9491-74a67e318fcc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:06.904065 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d8adabf2-738a-41cf-9491-74a67e318fcc tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1572 microversion: 2.1 time: 0.152886 Jan 28 02:10:06.904642 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 507/1027] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:06 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:07.921279 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-98b44338-2f6e-4bef-9e50-c2d64969c3dd tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:07.921897 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-98b44338-2f6e-4bef-9e50-c2d64969c3dd tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:07.928152 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-98b44338-2f6e-4bef-9e50-c2d64969c3dd tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:07.928587 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-98b44338-2f6e-4bef-9e50-c2d64969c3dd tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:07.929344 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-98b44338-2f6e-4bef-9e50-c2d64969c3dd tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:07.929797 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-98b44338-2f6e-4bef-9e50-c2d64969c3dd tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:08.054777 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-98b44338-2f6e-4bef-9e50-c2d64969c3dd tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:08.063758 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-98b44338-2f6e-4bef-9e50-c2d64969c3dd tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1572 microversion: 2.1 time: 0.146027 Jan 28 02:10:08.064409 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 521/1028] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:07 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1572 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:09.083504 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-940ac14a-9be3-4cbf-85f5-bc9b7107995a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:09.084109 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-940ac14a-9be3-4cbf-85f5-bc9b7107995a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:09.089929 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-940ac14a-9be3-4cbf-85f5-bc9b7107995a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:09.090375 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-940ac14a-9be3-4cbf-85f5-bc9b7107995a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:09.091150 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-940ac14a-9be3-4cbf-85f5-bc9b7107995a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:09.091578 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-940ac14a-9be3-4cbf-85f5-bc9b7107995a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:09.215161 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-940ac14a-9be3-4cbf-85f5-bc9b7107995a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:09.222550 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-940ac14a-9be3-4cbf-85f5-bc9b7107995a tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1572 microversion: 2.1 time: 0.143458 Jan 28 02:10:09.223156 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 508/1029] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:09 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1572 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:10.240546 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f06b2dc6-80ea-42e9-b77f-11f5851a80ad tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:10.241148 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f06b2dc6-80ea-42e9-b77f-11f5851a80ad tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:10.246960 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f06b2dc6-80ea-42e9-b77f-11f5851a80ad tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:10.247401 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f06b2dc6-80ea-42e9-b77f-11f5851a80ad tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:10.248186 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f06b2dc6-80ea-42e9-b77f-11f5851a80ad tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:10.248618 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f06b2dc6-80ea-42e9-b77f-11f5851a80ad tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:10.388950 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f06b2dc6-80ea-42e9-b77f-11f5851a80ad tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:10.400967 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f06b2dc6-80ea-42e9-b77f-11f5851a80ad tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1572 microversion: 2.1 time: 0.164594 Jan 28 02:10:10.401682 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 522/1030] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:10 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1572 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:11.288581 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7cd14d01-820f-4366-bfb7-b18409e19c8f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:11.294858 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7cd14d01-820f-4366-bfb7-b18409e19c8f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:11.295296 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7cd14d01-820f-4366-bfb7-b18409e19c8f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:11.354788 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7cd14d01-820f-4366-bfb7-b18409e19c8f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Going to try to stop instance {{(pid=115760) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Jan 28 02:10:11.400065 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7cd14d01-820f-4366-bfb7-b18409e19c8f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 202 len: 0 microversion: 2.1 time: 0.114948 Jan 28 02:10:11.401049 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 509/1031] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:10:11 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:10:11.409382 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4fc184b0-052b-44bd-bcb3-ff278d1f1994 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:11.410025 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4fc184b0-052b-44bd-bcb3-ff278d1f1994 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:11.416594 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4fc184b0-052b-44bd-bcb3-ff278d1f1994 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:11.417045 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4fc184b0-052b-44bd-bcb3-ff278d1f1994 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:11.417885 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4fc184b0-052b-44bd-bcb3-ff278d1f1994 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:11.418328 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4fc184b0-052b-44bd-bcb3-ff278d1f1994 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:11.420735 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7cdbc193-db19-48e0-ab77-15f69649f026 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:11.421881 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7cdbc193-db19-48e0-ab77-15f69649f026 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:11.428316 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7cdbc193-db19-48e0-ab77-15f69649f026 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:11.428758 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7cdbc193-db19-48e0-ab77-15f69649f026 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:11.429534 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7cdbc193-db19-48e0-ab77-15f69649f026 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:11.429989 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7cdbc193-db19-48e0-ab77-15f69649f026 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:11.606278 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4fc184b0-052b-44bd-bcb3-ff278d1f1994 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:11.611521 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-7cdbc193-db19-48e0-ab77-15f69649f026 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:11.615165 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4fc184b0-052b-44bd-bcb3-ff278d1f1994 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.209772 Jan 28 02:10:11.615933 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 523/1032] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:11 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:11.619680 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7cdbc193-db19-48e0-ab77-15f69649f026 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1572 microversion: 2.1 time: 0.204478 Jan 28 02:10:11.626500 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 510/1033] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:11 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1572 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:11.740937 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-4471f543-d1e8-4bbb-90c0-8c36d0f730e9 req-f593160e-8618-4bd4-afe3-25b169031855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63f7e8f-3a5e-4636-8231-688a4b068f3a", "name": "network-vif-plugged", "status": "completed", "tag": "862311b2-2f81-451f-a875-dbcc86e8b247"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:11.742559 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:11.742559 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:10:11.750307 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-4471f543-d1e8-4bbb-90c0-8c36d0f730e9 req-f593160e-8618-4bd4-afe3-25b169031855 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:11.750735 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-4471f543-d1e8-4bbb-90c0-8c36d0f730e9 req-f593160e-8618-4bd4-afe3-25b169031855 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:11.761409 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-4471f543-d1e8-4bbb-90c0-8c36d0f730e9 req-f593160e-8618-4bd4-afe3-25b169031855 service nova] Creating event network-vif-plugged:862311b2-2f81-451f-a875-dbcc86e8b247 for instance e63f7e8f-3a5e-4636-8231-688a4b068f3a on hv-cinder-82497 Jan 28 02:10:11.766311 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-4471f543-d1e8-4bbb-90c0-8c36d0f730e9 req-f593160e-8618-4bd4-afe3-25b169031855 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029031 Jan 28 02:10:11.766890 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 524/1034] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:12.633330 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1c04af88-808b-4e4f-b891-660fe306125d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:12.633935 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1c04af88-808b-4e4f-b891-660fe306125d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:12.638644 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-984231b8-0ce3-4c2f-831f-0685fefcc054 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:12.639356 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-984231b8-0ce3-4c2f-831f-0685fefcc054 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:12.639820 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1c04af88-808b-4e4f-b891-660fe306125d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:12.640255 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1c04af88-808b-4e4f-b891-660fe306125d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:12.641018 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1c04af88-808b-4e4f-b891-660fe306125d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:12.641441 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1c04af88-808b-4e4f-b891-660fe306125d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:12.645262 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-984231b8-0ce3-4c2f-831f-0685fefcc054 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:12.645702 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-984231b8-0ce3-4c2f-831f-0685fefcc054 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:12.646505 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-984231b8-0ce3-4c2f-831f-0685fefcc054 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:12.646933 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-984231b8-0ce3-4c2f-831f-0685fefcc054 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:12.823091 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-1c04af88-808b-4e4f-b891-660fe306125d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:12.826940 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-984231b8-0ce3-4c2f-831f-0685fefcc054 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:12.831705 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1c04af88-808b-4e4f-b891-660fe306125d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.202515 Jan 28 02:10:12.832321 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 511/1035] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:12 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:12.835686 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-984231b8-0ce3-4c2f-831f-0685fefcc054 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1572 microversion: 2.1 time: 0.201486 Jan 28 02:10:12.836342 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 525/1036] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:12 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1572 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:13.849153 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3a7eb70b-e067-4f25-ba4f-70927ed4530f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:13.849710 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3a7eb70b-e067-4f25-ba4f-70927ed4530f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:13.851897 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0ed2993d-a353-4eb4-8cc2-80c19f6b7f54 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:13.852531 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0ed2993d-a353-4eb4-8cc2-80c19f6b7f54 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:13.855557 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3a7eb70b-e067-4f25-ba4f-70927ed4530f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:13.856456 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3a7eb70b-e067-4f25-ba4f-70927ed4530f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:13.857228 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3a7eb70b-e067-4f25-ba4f-70927ed4530f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:13.857658 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3a7eb70b-e067-4f25-ba4f-70927ed4530f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:13.858455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ed2993d-a353-4eb4-8cc2-80c19f6b7f54 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:13.858905 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ed2993d-a353-4eb4-8cc2-80c19f6b7f54 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:13.859673 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ed2993d-a353-4eb4-8cc2-80c19f6b7f54 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:13.860141 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ed2993d-a353-4eb4-8cc2-80c19f6b7f54 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:14.032549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-3a7eb70b-e067-4f25-ba4f-70927ed4530f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:14.037706 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0ed2993d-a353-4eb4-8cc2-80c19f6b7f54 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:14.040807 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3a7eb70b-e067-4f25-ba4f-70927ed4530f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.195338 Jan 28 02:10:14.041381 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 512/1037] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:13 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:14.045579 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0ed2993d-a353-4eb4-8cc2-80c19f6b7f54 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1559 microversion: 2.1 time: 0.197203 Jan 28 02:10:14.046179 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 526/1038] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:13 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:15.058045 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-97af9618-7083-4742-9378-d543ddd7e138 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:15.058642 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-97af9618-7083-4742-9378-d543ddd7e138 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:15.064536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-97af9618-7083-4742-9378-d543ddd7e138 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:15.064973 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-97af9618-7083-4742-9378-d543ddd7e138 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:15.065764 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-97af9618-7083-4742-9378-d543ddd7e138 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:15.066188 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-97af9618-7083-4742-9378-d543ddd7e138 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:15.193347 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-97af9618-7083-4742-9378-d543ddd7e138 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:15.201417 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-97af9618-7083-4742-9378-d543ddd7e138 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.147088 Jan 28 02:10:15.202011 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 513/1039] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:15 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:16.218867 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-42918712-7593-459f-9369-6528e1be2248 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:16.219456 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-42918712-7593-459f-9369-6528e1be2248 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:16.226237 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-42918712-7593-459f-9369-6528e1be2248 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:16.226873 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-42918712-7593-459f-9369-6528e1be2248 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:16.228638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-42918712-7593-459f-9369-6528e1be2248 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:16.229069 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-42918712-7593-459f-9369-6528e1be2248 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:16.346618 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-42918712-7593-459f-9369-6528e1be2248 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:16.354976 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-42918712-7593-459f-9369-6528e1be2248 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.139788 Jan 28 02:10:16.355532 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 527/1040] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:16 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:17.371415 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-aeeec7fd-3956-408a-8b0a-eb69d3f58456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:17.372022 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-aeeec7fd-3956-408a-8b0a-eb69d3f58456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:17.377968 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aeeec7fd-3956-408a-8b0a-eb69d3f58456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:17.378411 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aeeec7fd-3956-408a-8b0a-eb69d3f58456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:17.379178 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aeeec7fd-3956-408a-8b0a-eb69d3f58456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:17.379606 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aeeec7fd-3956-408a-8b0a-eb69d3f58456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:17.502452 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-aeeec7fd-3956-408a-8b0a-eb69d3f58456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:17.510242 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-aeeec7fd-3956-408a-8b0a-eb69d3f58456 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.142381 Jan 28 02:10:17.510857 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 514/1041] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:17 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:18.528103 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3ddc6690-6b0e-4fc2-8846-555344f170ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:18.528673 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3ddc6690-6b0e-4fc2-8846-555344f170ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:18.534551 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3ddc6690-6b0e-4fc2-8846-555344f170ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:18.535001 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3ddc6690-6b0e-4fc2-8846-555344f170ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:18.535759 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3ddc6690-6b0e-4fc2-8846-555344f170ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:18.536186 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3ddc6690-6b0e-4fc2-8846-555344f170ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:18.660062 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3ddc6690-6b0e-4fc2-8846-555344f170ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:18.668777 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3ddc6690-6b0e-4fc2-8846-555344f170ac tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.144788 Jan 28 02:10:18.669329 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 528/1042] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:18 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:19.686511 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-cfc929b3-2099-4bff-853f-f6a0f3a54d6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:19.687116 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-cfc929b3-2099-4bff-853f-f6a0f3a54d6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:19.694268 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cfc929b3-2099-4bff-853f-f6a0f3a54d6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:19.694714 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cfc929b3-2099-4bff-853f-f6a0f3a54d6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:19.695507 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cfc929b3-2099-4bff-853f-f6a0f3a54d6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:19.695937 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cfc929b3-2099-4bff-853f-f6a0f3a54d6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:19.826740 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-cfc929b3-2099-4bff-853f-f6a0f3a54d6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:19.834865 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-cfc929b3-2099-4bff-853f-f6a0f3a54d6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.152004 Jan 28 02:10:19.835612 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 515/1043] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:19 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:20.852361 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7e950081-f26b-4c40-8e33-4725a47d239b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:20.852995 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7e950081-f26b-4c40-8e33-4725a47d239b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:20.859718 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7e950081-f26b-4c40-8e33-4725a47d239b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:20.860159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7e950081-f26b-4c40-8e33-4725a47d239b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:20.860925 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7e950081-f26b-4c40-8e33-4725a47d239b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:20.861351 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7e950081-f26b-4c40-8e33-4725a47d239b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:20.984100 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7e950081-f26b-4c40-8e33-4725a47d239b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:20.991848 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7e950081-f26b-4c40-8e33-4725a47d239b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.143655 Jan 28 02:10:20.992411 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 529/1044] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:20 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:22.008684 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a4fad450-0ce0-49ea-b6ac-80d51a32484b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:22.009292 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a4fad450-0ce0-49ea-b6ac-80d51a32484b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:22.015231 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a4fad450-0ce0-49ea-b6ac-80d51a32484b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:22.015671 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a4fad450-0ce0-49ea-b6ac-80d51a32484b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:22.016428 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a4fad450-0ce0-49ea-b6ac-80d51a32484b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:22.016856 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a4fad450-0ce0-49ea-b6ac-80d51a32484b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:22.138092 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a4fad450-0ce0-49ea-b6ac-80d51a32484b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:22.147110 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a4fad450-0ce0-49ea-b6ac-80d51a32484b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.142104 Jan 28 02:10:22.147727 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 516/1045] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:22 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:23.165792 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-93fbedd2-d54a-41cf-917f-0d86c5083311 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:23.166374 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-93fbedd2-d54a-41cf-917f-0d86c5083311 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:23.172378 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-93fbedd2-d54a-41cf-917f-0d86c5083311 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:23.172823 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-93fbedd2-d54a-41cf-917f-0d86c5083311 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:23.173603 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-93fbedd2-d54a-41cf-917f-0d86c5083311 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:23.174068 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-93fbedd2-d54a-41cf-917f-0d86c5083311 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:23.330857 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-93fbedd2-d54a-41cf-917f-0d86c5083311 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:23.339914 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-93fbedd2-d54a-41cf-917f-0d86c5083311 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.178236 Jan 28 02:10:23.340479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 530/1046] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:23 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:24.356981 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8f30432c-beef-4bf3-b697-cf95a7b29969 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:24.357603 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8f30432c-beef-4bf3-b697-cf95a7b29969 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:24.363933 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f30432c-beef-4bf3-b697-cf95a7b29969 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:24.364376 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f30432c-beef-4bf3-b697-cf95a7b29969 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:24.365161 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f30432c-beef-4bf3-b697-cf95a7b29969 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:24.365586 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f30432c-beef-4bf3-b697-cf95a7b29969 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:24.496382 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8f30432c-beef-4bf3-b697-cf95a7b29969 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:24.504320 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8f30432c-beef-4bf3-b697-cf95a7b29969 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.151119 Jan 28 02:10:24.504890 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 517/1047] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:24 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:25.523952 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-39fa656f-4028-443c-b929-f14a5b84af35 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:25.524518 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-39fa656f-4028-443c-b929-f14a5b84af35 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:25.530492 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-39fa656f-4028-443c-b929-f14a5b84af35 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:25.530937 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-39fa656f-4028-443c-b929-f14a5b84af35 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:25.531708 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-39fa656f-4028-443c-b929-f14a5b84af35 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:25.532138 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-39fa656f-4028-443c-b929-f14a5b84af35 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:25.654281 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-39fa656f-4028-443c-b929-f14a5b84af35 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:25.662246 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-39fa656f-4028-443c-b929-f14a5b84af35 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.143607 Jan 28 02:10:25.662823 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 531/1048] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:25 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:26.679726 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-71df8c73-d662-4c85-8512-882143d2a802 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:26.680424 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-71df8c73-d662-4c85-8512-882143d2a802 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:26.686358 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-71df8c73-d662-4c85-8512-882143d2a802 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:26.686805 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-71df8c73-d662-4c85-8512-882143d2a802 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:26.687573 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-71df8c73-d662-4c85-8512-882143d2a802 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:26.688001 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-71df8c73-d662-4c85-8512-882143d2a802 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:26.813926 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-71df8c73-d662-4c85-8512-882143d2a802 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:26.822171 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-71df8c73-d662-4c85-8512-882143d2a802 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1722 microversion: 2.1 time: 0.146008 Jan 28 02:10:26.822751 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 518/1049] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:26 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:27.840049 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a8eb42fb-454e-471c-807d-f90ab6f45bfe tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:27.840752 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a8eb42fb-454e-471c-807d-f90ab6f45bfe tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:27.846617 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a8eb42fb-454e-471c-807d-f90ab6f45bfe tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:27.847061 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a8eb42fb-454e-471c-807d-f90ab6f45bfe tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:27.847835 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a8eb42fb-454e-471c-807d-f90ab6f45bfe tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:27.848267 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a8eb42fb-454e-471c-807d-f90ab6f45bfe tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:27.973990 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a8eb42fb-454e-471c-807d-f90ab6f45bfe tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:27.983225 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a8eb42fb-454e-471c-807d-f90ab6f45bfe tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1699 microversion: 2.1 time: 0.146804 Jan 28 02:10:27.983800 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 532/1050] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:27 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1699 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:27.999279 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3c8e443a-fc53-408f-b740-b8a5b8b3984f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:28.005123 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3c8e443a-fc53-408f-b740-b8a5b8b3984f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:28.005566 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3c8e443a-fc53-408f-b740-b8a5b8b3984f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:28.027878 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3c8e443a-fc53-408f-b740-b8a5b8b3984f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Going to try to start instance {{(pid=115760) start /opt/stack/nova/nova/compute/api.py:2675}} Jan 28 02:10:28.069909 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3c8e443a-fc53-408f-b740-b8a5b8b3984f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 202 len: 0 microversion: 2.1 time: 0.074157 Jan 28 02:10:28.070573 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 519/1051] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:10:27 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:10:28.079280 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e4d59162-337f-47bc-acd4-f1368aa9946a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:28.079864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e4d59162-337f-47bc-acd4-f1368aa9946a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:28.086261 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4d59162-337f-47bc-acd4-f1368aa9946a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:28.086722 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4d59162-337f-47bc-acd4-f1368aa9946a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:28.087514 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4d59162-337f-47bc-acd4-f1368aa9946a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:28.088011 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e4d59162-337f-47bc-acd4-f1368aa9946a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:28.215936 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e4d59162-337f-47bc-acd4-f1368aa9946a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:28.223896 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e4d59162-337f-47bc-acd4-f1368aa9946a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1708 microversion: 2.1 time: 0.148312 Jan 28 02:10:28.224465 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 533/1052] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:28 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:29.242542 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-75527d0f-289d-4b49-ad94-2f08ef9e76c2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:29.243251 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-75527d0f-289d-4b49-ad94-2f08ef9e76c2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:29.249279 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-75527d0f-289d-4b49-ad94-2f08ef9e76c2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:29.249732 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-75527d0f-289d-4b49-ad94-2f08ef9e76c2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:29.250530 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-75527d0f-289d-4b49-ad94-2f08ef9e76c2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:29.250960 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-75527d0f-289d-4b49-ad94-2f08ef9e76c2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:29.378426 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-75527d0f-289d-4b49-ad94-2f08ef9e76c2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:29.386394 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-75527d0f-289d-4b49-ad94-2f08ef9e76c2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1708 microversion: 2.1 time: 0.148603 Jan 28 02:10:29.386993 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 520/1053] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:29 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:30.403645 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3ef7af83-a690-41b8-9453-57eca96e8e1b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:30.404330 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3ef7af83-a690-41b8-9453-57eca96e8e1b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:30.410464 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3ef7af83-a690-41b8-9453-57eca96e8e1b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:30.410916 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3ef7af83-a690-41b8-9453-57eca96e8e1b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:30.411695 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3ef7af83-a690-41b8-9453-57eca96e8e1b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:30.412126 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3ef7af83-a690-41b8-9453-57eca96e8e1b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:30.542067 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3ef7af83-a690-41b8-9453-57eca96e8e1b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:30.550224 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3ef7af83-a690-41b8-9453-57eca96e8e1b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1712 microversion: 2.1 time: 0.150194 Jan 28 02:10:30.550794 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 534/1054] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:30 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1712 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:38.584425 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1761841249", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1346427623", "security_groups": [{"name": "tempest-secgroup-smoke-43440463"}], "block_device_mapping_v2": [{"uuid": "c413815a-8223-4dfb-b742-4145978744fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7946a91b-c87f-479e-b41f-92c9cd8d4828"}]}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:38.706698 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.network.neutron [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] validate_networks() for [('7946a91b-c87f-479e-b41f-92c9cd8d4828', None, None, None, None, None)] {{(pid=115760) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:10:39.085701 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Flavor limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:10:39.086148 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Image limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:10:39.086642 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Flavor pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:10:39.087051 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Image pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:10:39.087454 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:10:39.096010 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:39.096450 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:39.097237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:39.097665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:39.114529 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Getting quotas for project d88874e13aa04221b933b43cb2350ad2. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:10:39.118430 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Getting quotas for user 44ac16b6ba0c415da52972cda26bbd2d and project d88874e13aa04221b933b43cb2350ad2. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:10:39.178662 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Going to run 1 instances... {{(pid=115760) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:10:39.180801 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c413815a-8223-4dfb-b742-4145978744fa',volume_size=None,volume_type=None)] {{(pid=115760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:10:39.318229 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5d15046b-43b8-4fa8-818f-42b5b6d5e911 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.737372 Jan 28 02:10:39.318880 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 521/1055] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:10:38 2022] POST /compute/v2.1/servers => generated 404 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:10:39.329638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f8e05fb9-cb07-4315-bd7a-afebe40d20b9 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:39.330296 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f8e05fb9-cb07-4315-bd7a-afebe40d20b9 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:39.383305 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f8e05fb9-cb07-4315-bd7a-afebe40d20b9 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:39.389889 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f8e05fb9-cb07-4315-bd7a-afebe40d20b9 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1095 microversion: 2.1 time: 0.063937 Jan 28 02:10:39.390452 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 535/1056] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:39 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:40.408728 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-0b8d7293-c455-43cd-bfc9-b5b855fdc9a7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:40.409394 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-0b8d7293-c455-43cd-bfc9-b5b855fdc9a7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:40.417871 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0b8d7293-c455-43cd-bfc9-b5b855fdc9a7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:40.418309 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0b8d7293-c455-43cd-bfc9-b5b855fdc9a7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:40.419078 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0b8d7293-c455-43cd-bfc9-b5b855fdc9a7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:40.419506 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0b8d7293-c455-43cd-bfc9-b5b855fdc9a7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:40.486406 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-0b8d7293-c455-43cd-bfc9-b5b855fdc9a7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:40.494121 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-0b8d7293-c455-43cd-bfc9-b5b855fdc9a7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1201 microversion: 2.1 time: 0.089837 Jan 28 02:10:40.494692 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 522/1057] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:40 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:41.510627 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-59d0ed1c-138e-4f52-9459-6eeb2fab970f tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:41.511505 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-59d0ed1c-138e-4f52-9459-6eeb2fab970f tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:41.518250 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-59d0ed1c-138e-4f52-9459-6eeb2fab970f tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.518688 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-59d0ed1c-138e-4f52-9459-6eeb2fab970f tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:41.519711 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-59d0ed1c-138e-4f52-9459-6eeb2fab970f tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.520299 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-59d0ed1c-138e-4f52-9459-6eeb2fab970f tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:41.654755 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-59d0ed1c-138e-4f52-9459-6eeb2fab970f tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:41.664053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-59d0ed1c-138e-4f52-9459-6eeb2fab970f tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1277 microversion: 2.1 time: 0.157406 Jan 28 02:10:41.664996 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 536/1058] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:41 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:41.933173 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-14dea2e6-60e4-4b35-9abf-23a0bb85b8c4 req-da86f98c-388c-4235-b2d7-53c756b47347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0dd16ec-7053-428e-8113-7d7c01cfc067", "tag": "3b7c3179-5b9c-4779-8b0d-407f4b619b44"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:41.937670 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:41.937670 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:10:41.948074 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-14dea2e6-60e4-4b35-9abf-23a0bb85b8c4 req-da86f98c-388c-4235-b2d7-53c756b47347 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.948696 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-14dea2e6-60e4-4b35-9abf-23a0bb85b8c4 req-da86f98c-388c-4235-b2d7-53c756b47347 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:41.961567 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-14dea2e6-60e4-4b35-9abf-23a0bb85b8c4 req-da86f98c-388c-4235-b2d7-53c756b47347 service nova] Creating event network-changed:3b7c3179-5b9c-4779-8b0d-407f4b619b44 for instance e0dd16ec-7053-428e-8113-7d7c01cfc067 on hv-cinder-82497 Jan 28 02:10:41.966665 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-14dea2e6-60e4-4b35-9abf-23a0bb85b8c4 req-da86f98c-388c-4235-b2d7-53c756b47347 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043438 Jan 28 02:10:41.967293 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 523/1059] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:42.682176 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a2787163-aa4a-4f3c-a4f2-79783a37682e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:42.682760 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a2787163-aa4a-4f3c-a4f2-79783a37682e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:42.688635 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a2787163-aa4a-4f3c-a4f2-79783a37682e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:42.689080 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a2787163-aa4a-4f3c-a4f2-79783a37682e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:42.689938 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a2787163-aa4a-4f3c-a4f2-79783a37682e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:42.690624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a2787163-aa4a-4f3c-a4f2-79783a37682e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:42.820649 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a2787163-aa4a-4f3c-a4f2-79783a37682e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:42.828410 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a2787163-aa4a-4f3c-a4f2-79783a37682e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1265 microversion: 2.1 time: 0.150576 Jan 28 02:10:42.828987 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 537/1060] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:42 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:43.845775 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b7f7758e-32b0-4d99-82a0-0c0b609f69ec tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:43.846475 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b7f7758e-32b0-4d99-82a0-0c0b609f69ec tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:43.852941 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b7f7758e-32b0-4d99-82a0-0c0b609f69ec tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:43.853382 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b7f7758e-32b0-4d99-82a0-0c0b609f69ec tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:43.854183 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b7f7758e-32b0-4d99-82a0-0c0b609f69ec tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:43.854604 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b7f7758e-32b0-4d99-82a0-0c0b609f69ec tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:43.976607 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b7f7758e-32b0-4d99-82a0-0c0b609f69ec tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:43.983837 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b7f7758e-32b0-4d99-82a0-0c0b609f69ec tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1265 microversion: 2.1 time: 0.142214 Jan 28 02:10:43.984395 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 524/1061] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:43 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:45.000097 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ec08d665-7003-4cc6-ba24-38e2986762c0 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:45.000685 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ec08d665-7003-4cc6-ba24-38e2986762c0 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:45.007212 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec08d665-7003-4cc6-ba24-38e2986762c0 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:45.007657 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec08d665-7003-4cc6-ba24-38e2986762c0 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:45.008428 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec08d665-7003-4cc6-ba24-38e2986762c0 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:45.008856 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec08d665-7003-4cc6-ba24-38e2986762c0 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:45.128689 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ec08d665-7003-4cc6-ba24-38e2986762c0 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:45.136588 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ec08d665-7003-4cc6-ba24-38e2986762c0 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1265 microversion: 2.1 time: 0.140161 Jan 28 02:10:45.137156 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 538/1062] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:44 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:46.152892 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-75bf65e9-6f17-4dbe-b5c8-c3b2aa6cee24 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:46.153707 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-75bf65e9-6f17-4dbe-b5c8-c3b2aa6cee24 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:46.159456 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-75bf65e9-6f17-4dbe-b5c8-c3b2aa6cee24 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:46.159894 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-75bf65e9-6f17-4dbe-b5c8-c3b2aa6cee24 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:46.160635 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-75bf65e9-6f17-4dbe-b5c8-c3b2aa6cee24 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:46.161057 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-75bf65e9-6f17-4dbe-b5c8-c3b2aa6cee24 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:46.285533 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-75bf65e9-6f17-4dbe-b5c8-c3b2aa6cee24 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:46.293577 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-75bf65e9-6f17-4dbe-b5c8-c3b2aa6cee24 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1265 microversion: 2.1 time: 0.144370 Jan 28 02:10:46.294179 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 525/1063] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:46 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:47.310479 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-71c2892b-1d0d-4472-ac6b-23b47a9730c1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:47.311084 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-71c2892b-1d0d-4472-ac6b-23b47a9730c1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:47.317099 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-71c2892b-1d0d-4472-ac6b-23b47a9730c1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:47.317567 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-71c2892b-1d0d-4472-ac6b-23b47a9730c1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:47.318355 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-71c2892b-1d0d-4472-ac6b-23b47a9730c1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:47.318786 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-71c2892b-1d0d-4472-ac6b-23b47a9730c1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:47.456626 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-71c2892b-1d0d-4472-ac6b-23b47a9730c1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:47.464306 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-71c2892b-1d0d-4472-ac6b-23b47a9730c1 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1265 microversion: 2.1 time: 0.157507 Jan 28 02:10:47.464871 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 539/1064] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:47 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:48.485571 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-cb905a79-306a-4cfa-b447-c5b2a2720e89 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:48.486178 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-cb905a79-306a-4cfa-b447-c5b2a2720e89 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:48.492627 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cb905a79-306a-4cfa-b447-c5b2a2720e89 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:48.493066 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cb905a79-306a-4cfa-b447-c5b2a2720e89 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:48.493938 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cb905a79-306a-4cfa-b447-c5b2a2720e89 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:48.494373 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-cb905a79-306a-4cfa-b447-c5b2a2720e89 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:48.613830 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-cb905a79-306a-4cfa-b447-c5b2a2720e89 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:48.621674 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-cb905a79-306a-4cfa-b447-c5b2a2720e89 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1265 microversion: 2.1 time: 0.139739 Jan 28 02:10:48.622272 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 526/1065] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:48 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:49.638420 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7ae1c26a-14c8-430c-adbb-b08f6b4c5da6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:49.638970 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7ae1c26a-14c8-430c-adbb-b08f6b4c5da6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:49.644847 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7ae1c26a-14c8-430c-adbb-b08f6b4c5da6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:49.645287 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7ae1c26a-14c8-430c-adbb-b08f6b4c5da6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:49.646083 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7ae1c26a-14c8-430c-adbb-b08f6b4c5da6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:49.646508 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-7ae1c26a-14c8-430c-adbb-b08f6b4c5da6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:49.832043 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7ae1c26a-14c8-430c-adbb-b08f6b4c5da6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:49.839497 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7ae1c26a-14c8-430c-adbb-b08f6b4c5da6 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1265 microversion: 2.1 time: 0.204713 Jan 28 02:10:49.840057 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 540/1066] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:49 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:50.856995 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8255da19-4c1d-429c-ada6-04e7bfa21605 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:50.870340 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8255da19-4c1d-429c-ada6-04e7bfa21605 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:50.870340 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8255da19-4c1d-429c-ada6-04e7bfa21605 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:50.870340 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8255da19-4c1d-429c-ada6-04e7bfa21605 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:50.870340 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8255da19-4c1d-429c-ada6-04e7bfa21605 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:50.871048 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8255da19-4c1d-429c-ada6-04e7bfa21605 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:50.996087 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8255da19-4c1d-429c-ada6-04e7bfa21605 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:51.003320 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8255da19-4c1d-429c-ada6-04e7bfa21605 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1265 microversion: 2.1 time: 0.150848 Jan 28 02:10:51.003900 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 527/1067] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:50 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:52.020396 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4b208484-0509-4383-aa18-c8ef84b07f8d tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:52.021050 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4b208484-0509-4383-aa18-c8ef84b07f8d tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:52.027383 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4b208484-0509-4383-aa18-c8ef84b07f8d tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:52.027831 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4b208484-0509-4383-aa18-c8ef84b07f8d tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:52.028619 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4b208484-0509-4383-aa18-c8ef84b07f8d tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:52.029059 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4b208484-0509-4383-aa18-c8ef84b07f8d tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:52.046993 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-3992e054-7014-4687-93b8-1b49b9903786 req-b397f2ef-b7d8-4db9-8cb3-a69b949c9e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0dd16ec-7053-428e-8113-7d7c01cfc067", "name": "network-vif-plugged", "status": "completed", "tag": "3b7c3179-5b9c-4779-8b0d-407f4b619b44"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:52.049361 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:52.049361 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:10:52.056473 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-3992e054-7014-4687-93b8-1b49b9903786 req-b397f2ef-b7d8-4db9-8cb3-a69b949c9e88 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:52.056768 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-3992e054-7014-4687-93b8-1b49b9903786 req-b397f2ef-b7d8-4db9-8cb3-a69b949c9e88 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:52.071327 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-3992e054-7014-4687-93b8-1b49b9903786 req-b397f2ef-b7d8-4db9-8cb3-a69b949c9e88 service nova] Creating event network-vif-plugged:3b7c3179-5b9c-4779-8b0d-407f4b619b44 for instance e0dd16ec-7053-428e-8113-7d7c01cfc067 on hv-cinder-82497 Jan 28 02:10:52.077360 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-3992e054-7014-4687-93b8-1b49b9903786 req-b397f2ef-b7d8-4db9-8cb3-a69b949c9e88 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034067 Jan 28 02:10:52.078285 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 528/1068] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:10:52.160047 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4b208484-0509-4383-aa18-c8ef84b07f8d tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:52.168333 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4b208484-0509-4383-aa18-c8ef84b07f8d tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1265 microversion: 2.1 time: 0.151731 Jan 28 02:10:52.168906 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 541/1069] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:52 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:53.185948 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f1b69ac1-8312-4da6-bdf0-caedd46c9083 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:53.186824 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f1b69ac1-8312-4da6-bdf0-caedd46c9083 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:53.193619 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f1b69ac1-8312-4da6-bdf0-caedd46c9083 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:53.194109 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f1b69ac1-8312-4da6-bdf0-caedd46c9083 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:53.194890 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f1b69ac1-8312-4da6-bdf0-caedd46c9083 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:53.195312 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f1b69ac1-8312-4da6-bdf0-caedd46c9083 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:53.321437 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-f1b69ac1-8312-4da6-bdf0-caedd46c9083 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:53.329007 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f1b69ac1-8312-4da6-bdf0-caedd46c9083 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1265 microversion: 2.1 time: 0.147093 Jan 28 02:10:53.329577 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 529/1070] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:53 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:54.345829 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a67b3058-50d2-4dbe-8bc0-a2a520462ff9 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:54.346441 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a67b3058-50d2-4dbe-8bc0-a2a520462ff9 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:54.352465 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a67b3058-50d2-4dbe-8bc0-a2a520462ff9 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:54.352916 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a67b3058-50d2-4dbe-8bc0-a2a520462ff9 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:54.353694 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a67b3058-50d2-4dbe-8bc0-a2a520462ff9 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:54.354156 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a67b3058-50d2-4dbe-8bc0-a2a520462ff9 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:54.476989 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-a67b3058-50d2-4dbe-8bc0-a2a520462ff9 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:54.485953 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a67b3058-50d2-4dbe-8bc0-a2a520462ff9 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1452 microversion: 2.1 time: 0.143716 Jan 28 02:10:54.486551 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 542/1071] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:54 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:54.503201 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8ac3253c-3665-4576-9978-e789ae1e1f47 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:54.503834 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8ac3253c-3665-4576-9978-e789ae1e1f47 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:54.510480 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8ac3253c-3665-4576-9978-e789ae1e1f47 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:54.510915 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8ac3253c-3665-4576-9978-e789ae1e1f47 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:54.511690 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8ac3253c-3665-4576-9978-e789ae1e1f47 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:54.512113 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8ac3253c-3665-4576-9978-e789ae1e1f47 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:54.634175 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-8ac3253c-3665-4576-9978-e789ae1e1f47 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:54.641619 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8ac3253c-3665-4576-9978-e789ae1e1f47 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1452 microversion: 2.1 time: 0.142276 Jan 28 02:10:54.642219 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 530/1072] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:54 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:56.504702 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-dea7cfd8-61c4-428b-9015-32d0a5e3e3f6 req-faf3e660-ea93-4a3e-a775-4d40e5514c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0dd16ec-7053-428e-8113-7d7c01cfc067", "tag": "3b7c3179-5b9c-4779-8b0d-407f4b619b44"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:56.506450 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:56.506450 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:10:56.516147 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-dea7cfd8-61c4-428b-9015-32d0a5e3e3f6 req-faf3e660-ea93-4a3e-a775-4d40e5514c60 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:56.516147 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-dea7cfd8-61c4-428b-9015-32d0a5e3e3f6 req-faf3e660-ea93-4a3e-a775-4d40e5514c60 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:56.526292 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-dea7cfd8-61c4-428b-9015-32d0a5e3e3f6 req-faf3e660-ea93-4a3e-a775-4d40e5514c60 service nova] Creating event network-changed:3b7c3179-5b9c-4779-8b0d-407f4b619b44 for instance e0dd16ec-7053-428e-8113-7d7c01cfc067 on hv-cinder-82497 Jan 28 02:10:56.532010 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-dea7cfd8-61c4-428b-9015-32d0a5e3e3f6 req-faf3e660-ea93-4a3e-a775-4d40e5514c60 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030846 Jan 28 02:10:56.532613 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 543/1073] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:12.927062 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-7952a475-7b40-404c-85d6-5625a2f493f7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:12.927700 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-7952a475-7b40-404c-85d6-5625a2f493f7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:12.935090 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7952a475-7b40-404c-85d6-5625a2f493f7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:12.935542 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7952a475-7b40-404c-85d6-5625a2f493f7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:12.936358 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7952a475-7b40-404c-85d6-5625a2f493f7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:12.936794 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-7952a475-7b40-404c-85d6-5625a2f493f7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:13.020889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.objects.instance [None req-7952a475-7b40-404c-85d6-5625a2f493f7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lazy-loading 'services' on Instance uuid 390009be-47d1-4368-93a3-f95c9c81ef18 {{(pid=115760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:11:13.084315 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-7952a475-7b40-404c-85d6-5625a2f493f7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "DELETE /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/os-volume_attachments/b865795c-4c3e-4cda-9522-4eacbd551fbd" status: 202 len: 0 microversion: 2.1 time: 0.161063 Jan 28 02:11:13.084916 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 531/1074] 10.222.0.77 () {58 vars in 1415 bytes} [Fri Jan 28 02:11:12 2022] DELETE /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/os-volume_attachments/b865795c-4c3e-4cda-9522-4eacbd551fbd => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:14.200677 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-56c412e6-dce9-471f-9597-886e5515c5d6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:14.207064 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-56c412e6-dce9-471f-9597-886e5515c5d6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:14.207504 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-56c412e6-dce9-471f-9597-886e5515c5d6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:14.266482 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-56c412e6-dce9-471f-9597-886e5515c5d6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Going to try to stop instance {{(pid=115761) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Jan 28 02:11:14.310298 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-56c412e6-dce9-471f-9597-886e5515c5d6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 202 len: 0 microversion: 2.1 time: 0.113616 Jan 28 02:11:14.310896 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 544/1075] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:11:14 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:14.319173 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a73bcf8d-6bd4-4a0a-8fd5-ae48210b1386 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:14.320013 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a73bcf8d-6bd4-4a0a-8fd5-ae48210b1386 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:14.326329 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a73bcf8d-6bd4-4a0a-8fd5-ae48210b1386 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:14.326771 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a73bcf8d-6bd4-4a0a-8fd5-ae48210b1386 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:14.327549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a73bcf8d-6bd4-4a0a-8fd5-ae48210b1386 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:14.327974 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a73bcf8d-6bd4-4a0a-8fd5-ae48210b1386 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:14.451708 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-a73bcf8d-6bd4-4a0a-8fd5-ae48210b1386 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:14.458927 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a73bcf8d-6bd4-4a0a-8fd5-ae48210b1386 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1676 microversion: 2.1 time: 0.143738 Jan 28 02:11:14.459481 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 532/1076] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:14 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1676 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:11:15.477037 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6722be79-25b6-41db-84d0-f63552ce7eb6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:15.477702 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6722be79-25b6-41db-84d0-f63552ce7eb6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:15.483911 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6722be79-25b6-41db-84d0-f63552ce7eb6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:15.484349 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6722be79-25b6-41db-84d0-f63552ce7eb6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:15.485117 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6722be79-25b6-41db-84d0-f63552ce7eb6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:15.485539 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6722be79-25b6-41db-84d0-f63552ce7eb6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:15.630827 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-6722be79-25b6-41db-84d0-f63552ce7eb6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:15.638358 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6722be79-25b6-41db-84d0-f63552ce7eb6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1676 microversion: 2.1 time: 0.165442 Jan 28 02:11:15.638928 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 545/1077] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:15 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:16.655460 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b710096e-bb80-4bc5-ad1c-c1f622261614 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:16.656008 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b710096e-bb80-4bc5-ad1c-c1f622261614 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:16.661993 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b710096e-bb80-4bc5-ad1c-c1f622261614 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:16.662432 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b710096e-bb80-4bc5-ad1c-c1f622261614 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:16.663188 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b710096e-bb80-4bc5-ad1c-c1f622261614 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:16.663610 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b710096e-bb80-4bc5-ad1c-c1f622261614 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:16.836431 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b710096e-bb80-4bc5-ad1c-c1f622261614 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:16.843901 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b710096e-bb80-4bc5-ad1c-c1f622261614 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1676 microversion: 2.1 time: 0.192136 Jan 28 02:11:16.844469 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 533/1078] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:16 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:17.859771 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-89d9e6f8-51f5-4693-8317-19cf22b6c2ec tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:17.860402 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-89d9e6f8-51f5-4693-8317-19cf22b6c2ec tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:17.866354 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-89d9e6f8-51f5-4693-8317-19cf22b6c2ec tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:17.866792 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-89d9e6f8-51f5-4693-8317-19cf22b6c2ec tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:17.867557 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-89d9e6f8-51f5-4693-8317-19cf22b6c2ec tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:17.867983 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-89d9e6f8-51f5-4693-8317-19cf22b6c2ec tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:17.986676 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-89d9e6f8-51f5-4693-8317-19cf22b6c2ec tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:17.993897 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-89d9e6f8-51f5-4693-8317-19cf22b6c2ec tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1676 microversion: 2.1 time: 0.137773 Jan 28 02:11:17.994456 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 546/1079] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:17 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1676 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:19.012142 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b92a81ea-6e2f-4e9c-a680-0b92744fb539 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:19.012759 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b92a81ea-6e2f-4e9c-a680-0b92744fb539 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:19.018629 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b92a81ea-6e2f-4e9c-a680-0b92744fb539 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:19.019067 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b92a81ea-6e2f-4e9c-a680-0b92744fb539 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:19.019825 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b92a81ea-6e2f-4e9c-a680-0b92744fb539 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:19.020251 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b92a81ea-6e2f-4e9c-a680-0b92744fb539 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:19.145329 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b92a81ea-6e2f-4e9c-a680-0b92744fb539 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:19.152555 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b92a81ea-6e2f-4e9c-a680-0b92744fb539 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1676 microversion: 2.1 time: 0.144105 Jan 28 02:11:19.153113 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 534/1080] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:19 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:20.169173 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f9ae75f4-7267-481f-8db1-33a24c6d15db tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:20.169828 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f9ae75f4-7267-481f-8db1-33a24c6d15db tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:20.176033 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f9ae75f4-7267-481f-8db1-33a24c6d15db tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:20.176477 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f9ae75f4-7267-481f-8db1-33a24c6d15db tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:20.177251 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f9ae75f4-7267-481f-8db1-33a24c6d15db tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:20.177680 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f9ae75f4-7267-481f-8db1-33a24c6d15db tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:20.348462 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f9ae75f4-7267-481f-8db1-33a24c6d15db tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:20.355843 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f9ae75f4-7267-481f-8db1-33a24c6d15db tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1676 microversion: 2.1 time: 0.190310 Jan 28 02:11:20.356408 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 547/1081] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:20 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:21.372496 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c9d10031-4e31-4e86-8d37-5df5b8776c83 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:21.373096 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c9d10031-4e31-4e86-8d37-5df5b8776c83 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:21.378890 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c9d10031-4e31-4e86-8d37-5df5b8776c83 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:21.379326 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c9d10031-4e31-4e86-8d37-5df5b8776c83 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:21.380083 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c9d10031-4e31-4e86-8d37-5df5b8776c83 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:21.380503 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-c9d10031-4e31-4e86-8d37-5df5b8776c83 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:21.508589 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c9d10031-4e31-4e86-8d37-5df5b8776c83 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:21.515932 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c9d10031-4e31-4e86-8d37-5df5b8776c83 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1676 microversion: 2.1 time: 0.147161 Jan 28 02:11:21.516489 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 535/1082] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:21 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:21.974939 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:11:21.975548 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: Fri Jan 28 02:11:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:11:22.533278 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-9dd12161-88d9-4032-8ec7-abd56d5e6073 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:22.533817 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-9dd12161-88d9-4032-8ec7-abd56d5e6073 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:22.540774 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9dd12161-88d9-4032-8ec7-abd56d5e6073 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:22.541211 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9dd12161-88d9-4032-8ec7-abd56d5e6073 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:22.542021 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9dd12161-88d9-4032-8ec7-abd56d5e6073 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:22.542480 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9dd12161-88d9-4032-8ec7-abd56d5e6073 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:22.674421 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-9dd12161-88d9-4032-8ec7-abd56d5e6073 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:22.682467 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-9dd12161-88d9-4032-8ec7-abd56d5e6073 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1676 microversion: 2.1 time: 0.152932 Jan 28 02:11:22.683041 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 548/1083] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:22 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:23.700107 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-f4b6dfc7-ad42-488f-b78a-556a93ea33cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:23.700984 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-f4b6dfc7-ad42-488f-b78a-556a93ea33cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:23.707678 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f4b6dfc7-ad42-488f-b78a-556a93ea33cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:23.708124 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f4b6dfc7-ad42-488f-b78a-556a93ea33cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:23.708903 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f4b6dfc7-ad42-488f-b78a-556a93ea33cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:23.709336 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-f4b6dfc7-ad42-488f-b78a-556a93ea33cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:23.833594 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-f4b6dfc7-ad42-488f-b78a-556a93ea33cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:23.840960 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-f4b6dfc7-ad42-488f-b78a-556a93ea33cc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1676 microversion: 2.1 time: 0.144508 Jan 28 02:11:23.841519 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 536/1084] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:23 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:24.857861 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8dea5c4a-4bfd-434c-8647-974867489cd3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:24.858490 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8dea5c4a-4bfd-434c-8647-974867489cd3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:24.864287 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8dea5c4a-4bfd-434c-8647-974867489cd3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:24.864732 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8dea5c4a-4bfd-434c-8647-974867489cd3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:24.865500 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8dea5c4a-4bfd-434c-8647-974867489cd3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:24.865965 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8dea5c4a-4bfd-434c-8647-974867489cd3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:24.984870 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-8dea5c4a-4bfd-434c-8647-974867489cd3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:24.993012 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8dea5c4a-4bfd-434c-8647-974867489cd3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1653 microversion: 2.1 time: 0.138935 Jan 28 02:11:24.993579 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 549/1085] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:24 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1653 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:25.010442 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-0ec30910-62c8-49bb-b7e5-fc6a7794a332 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:25.016556 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0ec30910-62c8-49bb-b7e5-fc6a7794a332 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:25.017342 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0ec30910-62c8-49bb-b7e5-fc6a7794a332 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:25.041456 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-0ec30910-62c8-49bb-b7e5-fc6a7794a332 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Going to try to start instance {{(pid=115760) start /opt/stack/nova/nova/compute/api.py:2675}} Jan 28 02:11:25.083952 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-0ec30910-62c8-49bb-b7e5-fc6a7794a332 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action" status: 202 len: 0 microversion: 2.1 time: 0.077868 Jan 28 02:11:25.084587 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 537/1086] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:11:25 2022] POST /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:25.093715 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0b467bcb-c0ae-4879-9663-35934316cd90 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:25.094356 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0b467bcb-c0ae-4879-9663-35934316cd90 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:25.100523 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0b467bcb-c0ae-4879-9663-35934316cd90 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:25.100983 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0b467bcb-c0ae-4879-9663-35934316cd90 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:25.101976 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0b467bcb-c0ae-4879-9663-35934316cd90 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:25.103168 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0b467bcb-c0ae-4879-9663-35934316cd90 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:25.230912 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-0b467bcb-c0ae-4879-9663-35934316cd90 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:25.238267 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0b467bcb-c0ae-4879-9663-35934316cd90 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1662 microversion: 2.1 time: 0.148469 Jan 28 02:11:25.238839 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 550/1087] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:25 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:26.256349 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b50ac993-c031-4bc3-98b5-45bf1224e808 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:26.257029 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b50ac993-c031-4bc3-98b5-45bf1224e808 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:26.263856 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b50ac993-c031-4bc3-98b5-45bf1224e808 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:26.264297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b50ac993-c031-4bc3-98b5-45bf1224e808 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:26.265056 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b50ac993-c031-4bc3-98b5-45bf1224e808 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:26.265476 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b50ac993-c031-4bc3-98b5-45bf1224e808 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:26.389240 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-b50ac993-c031-4bc3-98b5-45bf1224e808 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:26.396463 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b50ac993-c031-4bc3-98b5-45bf1224e808 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1662 microversion: 2.1 time: 0.144091 Jan 28 02:11:26.397023 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 538/1088] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:26 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1662 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:27.414683 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-770c4d2e-385b-4070-b961-d3399651e484 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:27.415284 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-770c4d2e-385b-4070-b961-d3399651e484 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:27.421294 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-770c4d2e-385b-4070-b961-d3399651e484 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:27.421738 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-770c4d2e-385b-4070-b961-d3399651e484 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:27.422537 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-770c4d2e-385b-4070-b961-d3399651e484 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:27.422970 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-770c4d2e-385b-4070-b961-d3399651e484 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:27.545317 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-770c4d2e-385b-4070-b961-d3399651e484 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:27.556488 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-770c4d2e-385b-4070-b961-d3399651e484 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1666 microversion: 2.1 time: 0.145983 Jan 28 02:11:27.557209 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 551/1089] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:27 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1666 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:31.759049 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:11:31.759953 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: Fri Jan 28 02:11:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:11:38.391919 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1e04959e-71ca-4883-a200-273feb282fd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:38.392569 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1e04959e-71ca-4883-a200-273feb282fd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:38.394621 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-7b01cd25-65ca-46f3-b926-358d108ed2e7 req-6c5df854-c55b-4f32-9ac5-368667cbcc20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63f7e8f-3a5e-4636-8231-688a4b068f3a", "tag": "862311b2-2f81-451f-a875-dbcc86e8b247"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:38.396260 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:11:38.396260 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:11:38.398744 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1e04959e-71ca-4883-a200-273feb282fd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:38.399194 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1e04959e-71ca-4883-a200-273feb282fd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:38.399979 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1e04959e-71ca-4883-a200-273feb282fd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:38.400691 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1e04959e-71ca-4883-a200-273feb282fd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:38.403656 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-7b01cd25-65ca-46f3-b926-358d108ed2e7 req-6c5df854-c55b-4f32-9ac5-368667cbcc20 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:38.404175 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-7b01cd25-65ca-46f3-b926-358d108ed2e7 req-6c5df854-c55b-4f32-9ac5-368667cbcc20 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:38.416311 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-7b01cd25-65ca-46f3-b926-358d108ed2e7 req-6c5df854-c55b-4f32-9ac5-368667cbcc20 service nova] Creating event network-changed:862311b2-2f81-451f-a875-dbcc86e8b247 for instance e63f7e8f-3a5e-4636-8231-688a4b068f3a on hv-cinder-82497 Jan 28 02:11:38.421541 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-7b01cd25-65ca-46f3-b926-358d108ed2e7 req-6c5df854-c55b-4f32-9ac5-368667cbcc20 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030680 Jan 28 02:11:38.422399 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 552/1090] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:38.428749 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1e04959e-71ca-4883-a200-273feb282fd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:11:38.526346 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1e04959e-71ca-4883-a200-273feb282fd4 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 204 len: 0 microversion: 2.1 time: 0.137846 Jan 28 02:11:38.527262 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 539/1091] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:11:38 2022] DELETE /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:11:38.535858 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3b7ec714-2789-4eac-9c51-dc502c91d138 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:38.536566 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3b7ec714-2789-4eac-9c51-dc502c91d138 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:38.543769 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3b7ec714-2789-4eac-9c51-dc502c91d138 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:38.544209 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3b7ec714-2789-4eac-9c51-dc502c91d138 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:38.544993 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3b7ec714-2789-4eac-9c51-dc502c91d138 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:38.545420 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3b7ec714-2789-4eac-9c51-dc502c91d138 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:38.696073 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3b7ec714-2789-4eac-9c51-dc502c91d138 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:38.704336 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3b7ec714-2789-4eac-9c51-dc502c91d138 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1565 microversion: 2.1 time: 0.172404 Jan 28 02:11:38.705122 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 553/1092] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:38 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:39.722947 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3993fc72-f5f4-4ffe-b737-edd4e92e4ba3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:39.723686 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3993fc72-f5f4-4ffe-b737-edd4e92e4ba3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:39.730267 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3993fc72-f5f4-4ffe-b737-edd4e92e4ba3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:39.730713 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3993fc72-f5f4-4ffe-b737-edd4e92e4ba3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:39.731514 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3993fc72-f5f4-4ffe-b737-edd4e92e4ba3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:39.731943 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3993fc72-f5f4-4ffe-b737-edd4e92e4ba3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:39.866371 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-3993fc72-f5f4-4ffe-b737-edd4e92e4ba3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:39.874949 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3993fc72-f5f4-4ffe-b737-edd4e92e4ba3 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1447 microversion: 2.1 time: 0.155963 Jan 28 02:11:39.875521 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 540/1093] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:39 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:40.892087 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d93a7b07-6205-479f-acf2-6d00ffb1d91b tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:40.892708 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d93a7b07-6205-479f-acf2-6d00ffb1d91b tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:40.899351 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d93a7b07-6205-479f-acf2-6d00ffb1d91b tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:40.899800 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d93a7b07-6205-479f-acf2-6d00ffb1d91b tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:40.900591 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d93a7b07-6205-479f-acf2-6d00ffb1d91b tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:40.901016 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d93a7b07-6205-479f-acf2-6d00ffb1d91b tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:41.031972 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d93a7b07-6205-479f-acf2-6d00ffb1d91b tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:41.041032 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d93a7b07-6205-479f-acf2-6d00ffb1d91b tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1447 microversion: 2.1 time: 0.152550 Jan 28 02:11:41.041851 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 554/1094] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:40 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:41.092238 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-a12444dc-93f5-4dd9-81cc-8df12de20690 req-2d8beb69-43ff-4f33-8662-79e17a0ef44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63f7e8f-3a5e-4636-8231-688a4b068f3a", "name": "network-vif-deleted", "tag": "862311b2-2f81-451f-a875-dbcc86e8b247"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:41.093818 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:11:41.093818 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:11:41.101204 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-a12444dc-93f5-4dd9-81cc-8df12de20690 req-2d8beb69-43ff-4f33-8662-79e17a0ef44d service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:41.102194 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-a12444dc-93f5-4dd9-81cc-8df12de20690 req-2d8beb69-43ff-4f33-8662-79e17a0ef44d service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:41.113439 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-a12444dc-93f5-4dd9-81cc-8df12de20690 req-2d8beb69-43ff-4f33-8662-79e17a0ef44d service nova] Creating event network-vif-deleted:862311b2-2f81-451f-a875-dbcc86e8b247 for instance e63f7e8f-3a5e-4636-8231-688a4b068f3a on hv-cinder-82497 Jan 28 02:11:41.119768 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-a12444dc-93f5-4dd9-81cc-8df12de20690 req-2d8beb69-43ff-4f33-8662-79e17a0ef44d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030931 Jan 28 02:11:41.120963 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 541/1095] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:42.059506 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-be5b68d2-ecf8-498c-b588-ba4a3ebd7c87 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:42.060107 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-be5b68d2-ecf8-498c-b588-ba4a3ebd7c87 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:42.066439 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be5b68d2-ecf8-498c-b588-ba4a3ebd7c87 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:42.066878 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be5b68d2-ecf8-498c-b588-ba4a3ebd7c87 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:42.067666 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be5b68d2-ecf8-498c-b588-ba4a3ebd7c87 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:42.068084 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be5b68d2-ecf8-498c-b588-ba4a3ebd7c87 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:42.104936 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be5b68d2-ecf8-498c-b588-ba4a3ebd7c87 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:42.105274 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-be5b68d2-ecf8-498c-b588-ba4a3ebd7c87 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:42.105822 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-be5b68d2-ecf8-498c-b588-ba4a3ebd7c87 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lazy-loading 'fault' on Instance uuid e63f7e8f-3a5e-4636-8231-688a4b068f3a {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:11:42.148385 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-be5b68d2-ecf8-498c-b588-ba4a3ebd7c87 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b99882e3054e8da1240d6285ff0565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226f951c63d84729beaecf1a55d5a6a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:42.156302 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-be5b68d2-ecf8-498c-b588-ba4a3ebd7c87 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 200 len: 1177 microversion: 2.1 time: 0.100823 Jan 28 02:11:42.156893 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 555/1096] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:42 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 1177 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:43.175458 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-18fb071e-d864-4db4-bf39-d7c115050033 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:43.176144 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-18fb071e-d864-4db4-bf39-d7c115050033 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] [instance: e63f7e8f-3a5e-4636-8231-688a4b068f3a] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:43.182849 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-18fb071e-d864-4db4-bf39-d7c115050033 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:43.183296 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-18fb071e-d864-4db4-bf39-d7c115050033 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:43.184051 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-18fb071e-d864-4db4-bf39-d7c115050033 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:43.184479 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-18fb071e-d864-4db4-bf39-d7c115050033 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:43.197116 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-18fb071e-d864-4db4-bf39-d7c115050033 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] HTTP exception thrown: Instance e63f7e8f-3a5e-4636-8231-688a4b068f3a could not be found. Jan 28 02:11:43.197693 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-18fb071e-d864-4db4-bf39-d7c115050033 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Returning 404 to user: Instance e63f7e8f-3a5e-4636-8231-688a4b068f3a could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:11:43.198552 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-18fb071e-d864-4db4-bf39-d7c115050033 tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a" status: 404 len: 111 microversion: 2.1 time: 0.027196 Jan 28 02:11:43.199059 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 542/1097] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:43 2022] GET /compute/v2.1/servers/e63f7e8f-3a5e-4636-8231-688a4b068f3a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:11:43.354662 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-2ef1b98f-9e44-48db-bef4-46540fbdfe7b tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] Calling method '.version_select at 0x7f08d5b73310>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:43.374246 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-2ef1b98f-9e44-48db-bef4-46540fbdfe7b tempest-TestShelveInstance-1466999544 tempest-TestShelveInstance-1466999544-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-576847230" status: 202 len: 0 microversion: 2.1 time: 0.025927 Jan 28 02:11:43.375095 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 556/1098] 10.222.0.77 () {58 vars in 1250 bytes} [Fri Jan 28 02:11:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-576847230 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:12:00.387682 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8d63fc7e-3010-40d7-ae15-afc3d89f7e98 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:00.388589 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8d63fc7e-3010-40d7-ae15-afc3d89f7e98 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:00.394580 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8d63fc7e-3010-40d7-ae15-afc3d89f7e98 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:00.395020 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8d63fc7e-3010-40d7-ae15-afc3d89f7e98 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:00.396603 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8d63fc7e-3010-40d7-ae15-afc3d89f7e98 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:00.396603 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8d63fc7e-3010-40d7-ae15-afc3d89f7e98 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:00.426018 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8d63fc7e-3010-40d7-ae15-afc3d89f7e98 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042508 Jan 28 02:12:00.426569 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 543/1099] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:12:00 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:12:00.501886 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-b56676fd-6279-4bdb-ad7f-eda7f68fe30f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:00.503166 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b56676fd-6279-4bdb-ad7f-eda7f68fe30f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:00.509304 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b56676fd-6279-4bdb-ad7f-eda7f68fe30f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:00.510304 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b56676fd-6279-4bdb-ad7f-eda7f68fe30f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:00.511058 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b56676fd-6279-4bdb-ad7f-eda7f68fe30f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:00.511487 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-b56676fd-6279-4bdb-ad7f-eda7f68fe30f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:00.536999 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-b56676fd-6279-4bdb-ad7f-eda7f68fe30f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Going to try to terminate instance {{(pid=115761) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:12:00.618028 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-b56676fd-6279-4bdb-ad7f-eda7f68fe30f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "DELETE /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 204 len: 0 microversion: 2.1 time: 0.120269 Jan 28 02:12:00.618607 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 557/1100] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:12:00 2022] DELETE /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:12:00.627075 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-550c9650-f038-4be7-99de-0babc7b2e342 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:00.627679 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-550c9650-f038-4be7-99de-0babc7b2e342 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:00.633978 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-550c9650-f038-4be7-99de-0babc7b2e342 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:00.634429 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-550c9650-f038-4be7-99de-0babc7b2e342 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:00.635784 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-550c9650-f038-4be7-99de-0babc7b2e342 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:00.636219 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-550c9650-f038-4be7-99de-0babc7b2e342 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:00.768366 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-550c9650-f038-4be7-99de-0babc7b2e342 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:00.777546 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-550c9650-f038-4be7-99de-0babc7b2e342 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1672 microversion: 2.1 time: 0.154094 Jan 28 02:12:00.778147 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 544/1101] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:00 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:01.796480 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-aa2cc163-c6e7-49a3-9578-6644076de68c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:01.797165 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-aa2cc163-c6e7-49a3-9578-6644076de68c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:01.803095 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aa2cc163-c6e7-49a3-9578-6644076de68c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:01.803536 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aa2cc163-c6e7-49a3-9578-6644076de68c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:01.804314 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aa2cc163-c6e7-49a3-9578-6644076de68c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:01.804752 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-aa2cc163-c6e7-49a3-9578-6644076de68c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:01.930346 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-aa2cc163-c6e7-49a3-9578-6644076de68c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:01.937647 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-aa2cc163-c6e7-49a3-9578-6644076de68c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1672 microversion: 2.1 time: 0.145198 Jan 28 02:12:01.938756 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 558/1102] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:01 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:02.955982 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-04cdb158-b24b-449a-a75a-93a8d635666f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:02.956617 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-04cdb158-b24b-449a-a75a-93a8d635666f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:02.962464 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04cdb158-b24b-449a-a75a-93a8d635666f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:02.962907 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04cdb158-b24b-449a-a75a-93a8d635666f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:02.963722 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04cdb158-b24b-449a-a75a-93a8d635666f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:02.964144 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-04cdb158-b24b-449a-a75a-93a8d635666f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:03.092859 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-04cdb158-b24b-449a-a75a-93a8d635666f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:03.100577 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-04cdb158-b24b-449a-a75a-93a8d635666f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1672 microversion: 2.1 time: 0.148288 Jan 28 02:12:03.101139 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 545/1103] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:02 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:03.889101 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-655dbb9c-88c0-4afe-aafe-840aa5bf677f req-6b927bce-a094-4117-a5f9-d4ca34bda91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390009be-47d1-4368-93a3-f95c9c81ef18", "name": "network-vif-deleted", "tag": "6ea3818d-ee8e-44a7-954e-2458c4d478d4"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:03.890703 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:03.890703 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:12:03.899040 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-655dbb9c-88c0-4afe-aafe-840aa5bf677f req-6b927bce-a094-4117-a5f9-d4ca34bda91a service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:03.899542 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-655dbb9c-88c0-4afe-aafe-840aa5bf677f req-6b927bce-a094-4117-a5f9-d4ca34bda91a service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:03.911798 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-655dbb9c-88c0-4afe-aafe-840aa5bf677f req-6b927bce-a094-4117-a5f9-d4ca34bda91a service nova] Creating event network-vif-deleted:6ea3818d-ee8e-44a7-954e-2458c4d478d4 for instance 390009be-47d1-4368-93a3-f95c9c81ef18 on hv-cinder-82497 Jan 28 02:12:03.917741 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-655dbb9c-88c0-4afe-aafe-840aa5bf677f req-6b927bce-a094-4117-a5f9-d4ca34bda91a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247941 Jan 28 02:12:03.918374 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 559/1104] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:04.120925 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-95e152ed-c88d-4c33-bb1d-249dda6f33f1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:04.123071 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-95e152ed-c88d-4c33-bb1d-249dda6f33f1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:04.131148 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-95e152ed-c88d-4c33-bb1d-249dda6f33f1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:04.131677 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-95e152ed-c88d-4c33-bb1d-249dda6f33f1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:04.133132 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-95e152ed-c88d-4c33-bb1d-249dda6f33f1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:04.133668 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-95e152ed-c88d-4c33-bb1d-249dda6f33f1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:04.175628 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-95e152ed-c88d-4c33-bb1d-249dda6f33f1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:04.176069 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-95e152ed-c88d-4c33-bb1d-249dda6f33f1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:04.176509 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.objects.instance [None req-95e152ed-c88d-4c33-bb1d-249dda6f33f1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lazy-loading 'fault' on Instance uuid 390009be-47d1-4368-93a3-f95c9c81ef18 {{(pid=115760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:12:04.233877 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-95e152ed-c88d-4c33-bb1d-249dda6f33f1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:04.241611 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-95e152ed-c88d-4c33-bb1d-249dda6f33f1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 200 len: 1326 microversion: 2.1 time: 0.126230 Jan 28 02:12:04.242243 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 546/1105] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:04 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 1326 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:05.260777 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3dd16a2c-f7c5-483f-9b7d-a79ca9cb16dd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:05.261574 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3dd16a2c-f7c5-483f-9b7d-a79ca9cb16dd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:05.267587 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3dd16a2c-f7c5-483f-9b7d-a79ca9cb16dd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:05.268030 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3dd16a2c-f7c5-483f-9b7d-a79ca9cb16dd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:05.268802 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3dd16a2c-f7c5-483f-9b7d-a79ca9cb16dd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:05.269225 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3dd16a2c-f7c5-483f-9b7d-a79ca9cb16dd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:05.282624 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-3dd16a2c-f7c5-483f-9b7d-a79ca9cb16dd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] HTTP exception thrown: Instance 390009be-47d1-4368-93a3-f95c9c81ef18 could not be found. Jan 28 02:12:05.283204 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3dd16a2c-f7c5-483f-9b7d-a79ca9cb16dd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Returning 404 to user: Instance 390009be-47d1-4368-93a3-f95c9c81ef18 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:12:05.284051 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3dd16a2c-f7c5-483f-9b7d-a79ca9cb16dd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 404 len: 111 microversion: 2.1 time: 0.028513 Jan 28 02:12:05.284589 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 560/1106] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:05 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:12:05.292730 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d3505a64-2df8-41c5-b0da-ba63c314dd76 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '.version_select at 0x7f08d5cbcf70>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:05.298570 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2ef1d2b0-c1d3-44b9-b1c9-ae484e28f8a0] AMQP server on 10.222.0.77:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 28 02:12:05.314483 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d3505a64-2df8-41c5-b0da-ba63c314dd76 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1656210937" status: 202 len: 0 microversion: 2.1 time: 0.025268 Jan 28 02:12:05.315057 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 547/1107] 10.222.0.77 () {58 vars in 1220 bytes} [Fri Jan 28 02:12:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1656210937 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:12:05.952215 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d281a22f-19a0-48e4-8d50-adc4032565c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'create', calling method: .version_select at 0x7f08d5b5bf70>, body: {"keypair": {"name": "tempest-keypair-1534110585"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:05.970229 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-d281a22f-19a0-48e4-8d50-adc4032565c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Getting quotas for project ad1d1897a9674c6bbcd0e4d1bd0b55ab. Resources: {'key_pairs'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:12:05.974168 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-d281a22f-19a0-48e4-8d50-adc4032565c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Getting quotas for user c9d0c28025a44aa3a9f5cfca4d91070c and project ad1d1897a9674c6bbcd0e4d1bd0b55ab. Resources: {'key_pairs'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:12:06.110327 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-d281a22f-19a0-48e4-8d50-adc4032565c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Getting quotas for project ad1d1897a9674c6bbcd0e4d1bd0b55ab. Resources: {'key_pairs'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:12:06.113838 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-d281a22f-19a0-48e4-8d50-adc4032565c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Getting quotas for user c9d0c28025a44aa3a9f5cfca4d91070c and project ad1d1897a9674c6bbcd0e4d1bd0b55ab. Resources: {'key_pairs'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:12:06.126503 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d281a22f-19a0-48e4-8d50-adc4032565c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.178155 Jan 28 02:12:06.127110 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 561/1108] 10.222.0.77 () {60 vars in 1157 bytes} [Fri Jan 28 02:12:05 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:07.622191 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1243416077", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3e05f9b-588b-4d48-8a35-7443e06d1f95"}], "security_groups": [{"name": "tempest-securitygroup--34712120"}], "key_name": "tempest-keypair-1534110585", "user_data": "}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:07.643174 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO oslo.messaging._drivers.impl_rabbit [-] [2ef1d2b0-c1d3-44b9-b1c9-ae484e28f8a0] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 40024. Jan 28 02:12:07.718749 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.network.neutron [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] validate_networks() for [('a3e05f9b-588b-4d48-8a35-7443e06d1f95', None, None, None, None, None)] {{(pid=115760) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:12:08.085594 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Flavor limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:12:08.086051 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Image limits 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:12:08.086522 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Flavor pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:12:08.086949 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Image pref 0:0:0 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:12:08.087356 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.virt.hardware [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115760) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:12:08.095850 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:08.096278 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:08.097075 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:08.097505 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:08.113104 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Getting quotas for project ad1d1897a9674c6bbcd0e4d1bd0b55ab. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:12:08.116924 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.quota [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Getting quotas for user c9d0c28025a44aa3a9f5cfca4d91070c and project ad1d1897a9674c6bbcd0e4d1bd0b55ab. Resources: {'cores', 'ram', 'instances'} {{(pid=115760) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:12:08.127849 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Going to run 1 instances... {{(pid=115760) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:12:08.130182 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115760) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:12:08.176859 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-eb154207-65a2-4e29-8374-2169feebaddd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.560739 Jan 28 02:12:08.177491 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 548/1109] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:12:07 2022] POST /compute/v2.1/servers => generated 400 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:12:08.187758 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-7eb61fbb-cf7e-442d-96ea-ab360d6b0b20 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:08.188378 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-7eb61fbb-cf7e-442d-96ea-ab360d6b0b20 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:08.246409 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-7eb61fbb-cf7e-442d-96ea-ab360d6b0b20 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:08.254187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-7eb61fbb-cf7e-442d-96ea-ab360d6b0b20 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1238 microversion: 2.1 time: 0.070081 Jan 28 02:12:08.255291 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 562/1110] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:08 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:09.272196 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3fc78246-4dbd-4358-9c9d-a68de702fd9e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:09.272714 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3fc78246-4dbd-4358-9c9d-a68de702fd9e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:09.280912 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3fc78246-4dbd-4358-9c9d-a68de702fd9e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:09.281356 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3fc78246-4dbd-4358-9c9d-a68de702fd9e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:09.282164 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3fc78246-4dbd-4358-9c9d-a68de702fd9e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:09.282684 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3fc78246-4dbd-4358-9c9d-a68de702fd9e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:09.343190 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-3fc78246-4dbd-4358-9c9d-a68de702fd9e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:09.350464 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3fc78246-4dbd-4358-9c9d-a68de702fd9e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1296 microversion: 2.1 time: 0.082052 Jan 28 02:12:09.351029 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 549/1111] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:09 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:10.367538 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-bc7d8318-75bd-466b-bae2-c6996a365d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:10.368299 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-bc7d8318-75bd-466b-bae2-c6996a365d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:10.375362 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bc7d8318-75bd-466b-bae2-c6996a365d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:10.375932 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bc7d8318-75bd-466b-bae2-c6996a365d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:10.376951 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bc7d8318-75bd-466b-bae2-c6996a365d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:10.377458 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-bc7d8318-75bd-466b-bae2-c6996a365d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:10.485146 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-2496ee2f-5a1e-461d-90b1-6b6de62dc6db req-8da760e2-6f95-4b5e-8fbc-54adf7a68da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6390bcd-db15-4165-812c-b638fceaa5be", "tag": "1dbf75e2-16c1-4f57-99d5-c77559ce1033"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:10.489307 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:10.489307 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:12:10.507999 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-2496ee2f-5a1e-461d-90b1-6b6de62dc6db req-8da760e2-6f95-4b5e-8fbc-54adf7a68da9 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:10.508369 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-2496ee2f-5a1e-461d-90b1-6b6de62dc6db req-8da760e2-6f95-4b5e-8fbc-54adf7a68da9 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:10.524690 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-2496ee2f-5a1e-461d-90b1-6b6de62dc6db req-8da760e2-6f95-4b5e-8fbc-54adf7a68da9 service nova] Creating event network-changed:1dbf75e2-16c1-4f57-99d5-c77559ce1033 for instance c6390bcd-db15-4165-812c-b638fceaa5be on hv-cinder-82497 Jan 28 02:12:10.534495 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-2496ee2f-5a1e-461d-90b1-6b6de62dc6db req-8da760e2-6f95-4b5e-8fbc-54adf7a68da9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060524 Jan 28 02:12:10.535281 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 550/1112] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:10.557511 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-bc7d8318-75bd-466b-bae2-c6996a365d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:10.565584 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-bc7d8318-75bd-466b-bae2-c6996a365d6b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1362 microversion: 2.1 time: 0.201648 Jan 28 02:12:10.566425 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 563/1113] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:10 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:11.583781 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-997cb578-d72a-4f0e-90ba-ddd3e84def2a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:11.584536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-997cb578-d72a-4f0e-90ba-ddd3e84def2a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:11.591209 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-997cb578-d72a-4f0e-90ba-ddd3e84def2a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:11.591651 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-997cb578-d72a-4f0e-90ba-ddd3e84def2a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:11.592413 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-997cb578-d72a-4f0e-90ba-ddd3e84def2a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:11.592834 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-997cb578-d72a-4f0e-90ba-ddd3e84def2a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:11.715242 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-997cb578-d72a-4f0e-90ba-ddd3e84def2a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:11.722641 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-997cb578-d72a-4f0e-90ba-ddd3e84def2a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1362 microversion: 2.1 time: 0.142822 Jan 28 02:12:11.723183 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 551/1114] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:11 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:12.739771 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-47162c2b-3833-49e7-a724-5571d01ba70a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:12.740422 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-47162c2b-3833-49e7-a724-5571d01ba70a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:12.746930 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-47162c2b-3833-49e7-a724-5571d01ba70a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:12.747364 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-47162c2b-3833-49e7-a724-5571d01ba70a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:12.748135 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-47162c2b-3833-49e7-a724-5571d01ba70a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:12.748565 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-47162c2b-3833-49e7-a724-5571d01ba70a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:12.876302 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-47162c2b-3833-49e7-a724-5571d01ba70a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:12.883694 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-47162c2b-3833-49e7-a724-5571d01ba70a tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1362 microversion: 2.1 time: 0.147702 Jan 28 02:12:12.884256 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 564/1115] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:12 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:13.900820 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e2be3d1c-0ca7-42d5-8700-47daa0a04779 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:13.901372 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e2be3d1c-0ca7-42d5-8700-47daa0a04779 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:13.907170 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e2be3d1c-0ca7-42d5-8700-47daa0a04779 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:13.907618 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e2be3d1c-0ca7-42d5-8700-47daa0a04779 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:13.908478 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e2be3d1c-0ca7-42d5-8700-47daa0a04779 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:13.908824 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e2be3d1c-0ca7-42d5-8700-47daa0a04779 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:14.044699 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-e2be3d1c-0ca7-42d5-8700-47daa0a04779 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:14.051910 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-e2be3d1c-0ca7-42d5-8700-47daa0a04779 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1362 microversion: 2.1 time: 0.155029 Jan 28 02:12:14.052471 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 552/1116] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:13 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:15.068934 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1ddaf913-3e29-45b0-8e33-9370db0052f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:15.069486 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1ddaf913-3e29-45b0-8e33-9370db0052f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:15.076162 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1ddaf913-3e29-45b0-8e33-9370db0052f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:15.076608 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1ddaf913-3e29-45b0-8e33-9370db0052f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:15.077680 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1ddaf913-3e29-45b0-8e33-9370db0052f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:15.078153 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1ddaf913-3e29-45b0-8e33-9370db0052f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:15.205240 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-1ddaf913-3e29-45b0-8e33-9370db0052f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:15.212627 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1ddaf913-3e29-45b0-8e33-9370db0052f3 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1362 microversion: 2.1 time: 0.147709 Jan 28 02:12:15.213236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 565/1117] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:15 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:16.229975 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-69dd8a0d-8cf3-447e-bfb1-86984d680426 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:16.230571 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-69dd8a0d-8cf3-447e-bfb1-86984d680426 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:16.236643 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-69dd8a0d-8cf3-447e-bfb1-86984d680426 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:16.237080 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-69dd8a0d-8cf3-447e-bfb1-86984d680426 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:16.237885 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-69dd8a0d-8cf3-447e-bfb1-86984d680426 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:16.238314 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-69dd8a0d-8cf3-447e-bfb1-86984d680426 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:16.379303 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-69dd8a0d-8cf3-447e-bfb1-86984d680426 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:16.387469 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-69dd8a0d-8cf3-447e-bfb1-86984d680426 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1362 microversion: 2.1 time: 0.161656 Jan 28 02:12:16.388039 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 553/1118] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:16 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:16.429957 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-e94daddd-b4ff-4a78-ba92-a208acc0cf8f req-67d95e90-ca78-4e71-97d2-fb55159ff2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6390bcd-db15-4165-812c-b638fceaa5be", "name": "network-vif-plugged", "status": "completed", "tag": "1dbf75e2-16c1-4f57-99d5-c77559ce1033"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:16.431561 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:16.431561 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:12:16.439000 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-e94daddd-b4ff-4a78-ba92-a208acc0cf8f req-67d95e90-ca78-4e71-97d2-fb55159ff2c8 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:16.439455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-e94daddd-b4ff-4a78-ba92-a208acc0cf8f req-67d95e90-ca78-4e71-97d2-fb55159ff2c8 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:16.456863 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-e94daddd-b4ff-4a78-ba92-a208acc0cf8f req-67d95e90-ca78-4e71-97d2-fb55159ff2c8 service nova] Creating event network-vif-plugged:1dbf75e2-16c1-4f57-99d5-c77559ce1033 for instance c6390bcd-db15-4165-812c-b638fceaa5be on hv-cinder-82497 Jan 28 02:12:16.462391 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-e94daddd-b4ff-4a78-ba92-a208acc0cf8f req-67d95e90-ca78-4e71-97d2-fb55159ff2c8 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035856 Jan 28 02:12:16.463757 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 566/1119] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:17.403997 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-15ea345c-3132-4109-8f67-f9b44ad0900f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:17.404597 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-15ea345c-3132-4109-8f67-f9b44ad0900f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:17.410477 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-15ea345c-3132-4109-8f67-f9b44ad0900f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:17.410919 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-15ea345c-3132-4109-8f67-f9b44ad0900f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:17.411719 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-15ea345c-3132-4109-8f67-f9b44ad0900f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:17.412144 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-15ea345c-3132-4109-8f67-f9b44ad0900f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:17.536225 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-15ea345c-3132-4109-8f67-f9b44ad0900f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:17.543575 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-15ea345c-3132-4109-8f67-f9b44ad0900f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1362 microversion: 2.1 time: 0.143207 Jan 28 02:12:17.544126 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 554/1120] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:17 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:18.560723 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ec6fd1b6-0aa0-4b51-8920-03266ce573ed tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:18.561317 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ec6fd1b6-0aa0-4b51-8920-03266ce573ed tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:18.567404 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec6fd1b6-0aa0-4b51-8920-03266ce573ed tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:18.567845 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec6fd1b6-0aa0-4b51-8920-03266ce573ed tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:18.568606 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec6fd1b6-0aa0-4b51-8920-03266ce573ed tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:18.569030 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ec6fd1b6-0aa0-4b51-8920-03266ce573ed tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:18.690429 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-ec6fd1b6-0aa0-4b51-8920-03266ce573ed tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:18.698593 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ec6fd1b6-0aa0-4b51-8920-03266ce573ed tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1547 microversion: 2.1 time: 0.142426 Jan 28 02:12:18.699158 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 567/1121] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:18 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1547 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:18.714682 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-271f167e-04e5-49e2-b0ab-25398a58cb10 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:18.715198 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-271f167e-04e5-49e2-b0ab-25398a58cb10 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:18.721023 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-271f167e-04e5-49e2-b0ab-25398a58cb10 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:18.721467 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-271f167e-04e5-49e2-b0ab-25398a58cb10 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:18.722286 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-271f167e-04e5-49e2-b0ab-25398a58cb10 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:18.722719 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-271f167e-04e5-49e2-b0ab-25398a58cb10 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:18.806083 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-271f167e-04e5-49e2-b0ab-25398a58cb10 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094968 Jan 28 02:12:18.807188 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 555/1122] 10.222.0.77 () {58 vars in 1274 bytes} [Fri Jan 28 02:12:18 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:20.018362 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8aa2ba0d-1246-46ff-8576-0229f8368d74 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:20.019453 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8aa2ba0d-1246-46ff-8576-0229f8368d74 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:20.020382 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-9f806e44-859b-4387-a18d-2f9bc0571140 req-4997376f-271b-45e5-9251-52e225fa2f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6390bcd-db15-4165-812c-b638fceaa5be", "tag": "1dbf75e2-16c1-4f57-99d5-c77559ce1033"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:20.021939 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:20.021939 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:12:20.026660 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8aa2ba0d-1246-46ff-8576-0229f8368d74 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:20.027194 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8aa2ba0d-1246-46ff-8576-0229f8368d74 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:20.028357 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8aa2ba0d-1246-46ff-8576-0229f8368d74 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:20.028796 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8aa2ba0d-1246-46ff-8576-0229f8368d74 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:20.035029 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-9f806e44-859b-4387-a18d-2f9bc0571140 req-4997376f-271b-45e5-9251-52e225fa2f37 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:20.036096 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-9f806e44-859b-4387-a18d-2f9bc0571140 req-4997376f-271b-45e5-9251-52e225fa2f37 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:20.061474 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-9f806e44-859b-4387-a18d-2f9bc0571140 req-4997376f-271b-45e5-9251-52e225fa2f37 service nova] Creating event network-changed:1dbf75e2-16c1-4f57-99d5-c77559ce1033 for instance c6390bcd-db15-4165-812c-b638fceaa5be on hv-cinder-82497 Jan 28 02:12:20.070542 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-9f806e44-859b-4387-a18d-2f9bc0571140 req-4997376f-271b-45e5-9251-52e225fa2f37 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053520 Jan 28 02:12:20.071420 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 556/1123] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:20.137666 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8aa2ba0d-1246-46ff-8576-0229f8368d74 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 14 microversion: 2.1 time: 0.123158 Jan 28 02:12:20.142033 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 568/1124] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:20 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 02:12:21.150782 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-b4bf37cd-cedb-4256-82db-3f3f601a7dc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:21.151692 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-b4bf37cd-cedb-4256-82db-3f3f601a7dc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:21.158435 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b4bf37cd-cedb-4256-82db-3f3f601a7dc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:21.158883 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b4bf37cd-cedb-4256-82db-3f3f601a7dc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:21.159699 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b4bf37cd-cedb-4256-82db-3f3f601a7dc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:21.160120 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-b4bf37cd-cedb-4256-82db-3f3f601a7dc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:21.255447 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-b4bf37cd-cedb-4256-82db-3f3f601a7dc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 14 microversion: 2.1 time: 0.109104 Jan 28 02:12:21.256218 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 557/1125] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:21 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:12:22.268355 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-a0befbc9-7327-4eac-bd51-f3fd12efd3e5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:22.269375 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-a0befbc9-7327-4eac-bd51-f3fd12efd3e5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:22.276908 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a0befbc9-7327-4eac-bd51-f3fd12efd3e5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:22.277345 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a0befbc9-7327-4eac-bd51-f3fd12efd3e5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:22.278150 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a0befbc9-7327-4eac-bd51-f3fd12efd3e5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:22.278577 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-a0befbc9-7327-4eac-bd51-f3fd12efd3e5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:22.357447 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-a0befbc9-7327-4eac-bd51-f3fd12efd3e5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 14 microversion: 2.1 time: 0.093707 Jan 28 02:12:22.358156 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 569/1126] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:22 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:12:23.368532 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-47e5922b-365f-4ac5-b671-f6e9f101ae84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:23.369983 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-47e5922b-365f-4ac5-b671-f6e9f101ae84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:23.376522 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-47e5922b-365f-4ac5-b671-f6e9f101ae84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:23.376961 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-47e5922b-365f-4ac5-b671-f6e9f101ae84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:23.377728 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-47e5922b-365f-4ac5-b671-f6e9f101ae84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:23.378346 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-47e5922b-365f-4ac5-b671-f6e9f101ae84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:23.459549 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-47e5922b-365f-4ac5-b671-f6e9f101ae84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 14 microversion: 2.1 time: 0.094921 Jan 28 02:12:23.460193 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 558/1127] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:23 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 02:12:24.470832 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f71b7a6f-6852-41fc-8374-dfcea71ea692 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:24.471881 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f71b7a6f-6852-41fc-8374-dfcea71ea692 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:24.478607 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f71b7a6f-6852-41fc-8374-dfcea71ea692 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:24.479053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f71b7a6f-6852-41fc-8374-dfcea71ea692 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:24.479832 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f71b7a6f-6852-41fc-8374-dfcea71ea692 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:24.480257 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f71b7a6f-6852-41fc-8374-dfcea71ea692 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:24.569265 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f71b7a6f-6852-41fc-8374-dfcea71ea692 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 14 microversion: 2.1 time: 0.102175 Jan 28 02:12:24.569846 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 570/1128] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:24 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:12:24.863288 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-1d998d57-81be-43f7-b737-bb25df781a00 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:24.863952 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-54ba47c0-9d79-4c0d-8c42-d77bcf1de6db req-ba297c44-dd9a-4485-8cb1-9a5541a7d1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0dd16ec-7053-428e-8113-7d7c01cfc067", "tag": "3b7c3179-5b9c-4779-8b0d-407f4b619b44"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:24.864100 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1d998d57-81be-43f7-b737-bb25df781a00 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:24.865408 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:24.865408 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:12:24.870598 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1d998d57-81be-43f7-b737-bb25df781a00 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:24.871038 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1d998d57-81be-43f7-b737-bb25df781a00 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:24.871831 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1d998d57-81be-43f7-b737-bb25df781a00 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:24.872263 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-1d998d57-81be-43f7-b737-bb25df781a00 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:24.873674 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-54ba47c0-9d79-4c0d-8c42-d77bcf1de6db req-ba297c44-dd9a-4485-8cb1-9a5541a7d1f3 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:24.874146 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-54ba47c0-9d79-4c0d-8c42-d77bcf1de6db req-ba297c44-dd9a-4485-8cb1-9a5541a7d1f3 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:24.886160 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-54ba47c0-9d79-4c0d-8c42-d77bcf1de6db req-ba297c44-dd9a-4485-8cb1-9a5541a7d1f3 service nova] Creating event network-changed:3b7c3179-5b9c-4779-8b0d-407f4b619b44 for instance e0dd16ec-7053-428e-8113-7d7c01cfc067 on hv-cinder-82497 Jan 28 02:12:24.900270 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-54ba47c0-9d79-4c0d-8c42-d77bcf1de6db req-ba297c44-dd9a-4485-8cb1-9a5541a7d1f3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040238 Jan 28 02:12:24.901863 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 571/1129] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:12:24.905979 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-1d998d57-81be-43f7-b737-bb25df781a00 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:12:25.003863 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-1d998d57-81be-43f7-b737-bb25df781a00 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 204 len: 0 microversion: 2.1 time: 0.145147 Jan 28 02:12:25.004853 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 559/1130] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:12:24 2022] DELETE /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:12:25.018752 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3a2dc508-f5f6-4667-a148-b26129438d0e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:25.020046 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3a2dc508-f5f6-4667-a148-b26129438d0e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:25.028739 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3a2dc508-f5f6-4667-a148-b26129438d0e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:25.029276 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3a2dc508-f5f6-4667-a148-b26129438d0e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:25.030209 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3a2dc508-f5f6-4667-a148-b26129438d0e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:25.031247 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3a2dc508-f5f6-4667-a148-b26129438d0e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:25.210078 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-3a2dc508-f5f6-4667-a148-b26129438d0e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:25.217599 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3a2dc508-f5f6-4667-a148-b26129438d0e tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1576 microversion: 2.1 time: 0.206131 Jan 28 02:12:25.223987 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 572/1131] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:25 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:25.585762 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-65bfbac3-cae3-41b6-8d49-622569b8839f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:25.587347 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-65bfbac3-cae3-41b6-8d49-622569b8839f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:25.594222 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-65bfbac3-cae3-41b6-8d49-622569b8839f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:25.594970 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-65bfbac3-cae3-41b6-8d49-622569b8839f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:25.595745 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-65bfbac3-cae3-41b6-8d49-622569b8839f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:25.596195 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-65bfbac3-cae3-41b6-8d49-622569b8839f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:25.678985 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-65bfbac3-cae3-41b6-8d49-622569b8839f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 14 microversion: 2.1 time: 0.100538 Jan 28 02:12:25.679788 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 560/1132] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:25 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:12:26.235490 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4fc837ea-4eea-4b1c-b66c-e5df994ca658 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:26.236019 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4fc837ea-4eea-4b1c-b66c-e5df994ca658 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:26.242416 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4fc837ea-4eea-4b1c-b66c-e5df994ca658 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:26.242858 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4fc837ea-4eea-4b1c-b66c-e5df994ca658 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:26.243635 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4fc837ea-4eea-4b1c-b66c-e5df994ca658 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:26.244143 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4fc837ea-4eea-4b1c-b66c-e5df994ca658 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:26.366798 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-4fc837ea-4eea-4b1c-b66c-e5df994ca658 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:26.374622 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4fc837ea-4eea-4b1c-b66c-e5df994ca658 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1458 microversion: 2.1 time: 0.142918 Jan 28 02:12:26.375183 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 573/1133] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:26 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1458 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:26.691316 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8555e2ee-13e3-4324-a43e-0060bf9b87e0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:26.692306 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8555e2ee-13e3-4324-a43e-0060bf9b87e0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:26.699003 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8555e2ee-13e3-4324-a43e-0060bf9b87e0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:26.699516 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8555e2ee-13e3-4324-a43e-0060bf9b87e0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:26.700227 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8555e2ee-13e3-4324-a43e-0060bf9b87e0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:26.700664 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8555e2ee-13e3-4324-a43e-0060bf9b87e0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:26.821591 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8555e2ee-13e3-4324-a43e-0060bf9b87e0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 14 microversion: 2.1 time: 0.134107 Jan 28 02:12:26.822865 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 561/1134] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:26 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 02:12:27.265570 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-a81e017d-22e7-4b9b-af70-a3e34e5351c4 req-3fd05c9e-0482-4a09-92cc-847f7986ad49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0dd16ec-7053-428e-8113-7d7c01cfc067", "name": "network-vif-deleted", "tag": "3b7c3179-5b9c-4779-8b0d-407f4b619b44"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:27.267377 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:27.267377 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:12:27.276493 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-a81e017d-22e7-4b9b-af70-a3e34e5351c4 req-3fd05c9e-0482-4a09-92cc-847f7986ad49 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:27.276929 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-a81e017d-22e7-4b9b-af70-a3e34e5351c4 req-3fd05c9e-0482-4a09-92cc-847f7986ad49 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:27.288521 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-a81e017d-22e7-4b9b-af70-a3e34e5351c4 req-3fd05c9e-0482-4a09-92cc-847f7986ad49 service nova] Creating event network-vif-deleted:3b7c3179-5b9c-4779-8b0d-407f4b619b44 for instance e0dd16ec-7053-428e-8113-7d7c01cfc067 on hv-cinder-82497 Jan 28 02:12:27.296595 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-a81e017d-22e7-4b9b-af70-a3e34e5351c4 req-3fd05c9e-0482-4a09-92cc-847f7986ad49 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034641 Jan 28 02:12:27.297276 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 574/1135] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:27.392628 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-12237db0-62c9-4f6c-a422-c13de5c8c791 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:27.393312 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-12237db0-62c9-4f6c-a422-c13de5c8c791 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:27.399802 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-12237db0-62c9-4f6c-a422-c13de5c8c791 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:27.400246 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-12237db0-62c9-4f6c-a422-c13de5c8c791 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:27.401604 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-12237db0-62c9-4f6c-a422-c13de5c8c791 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:27.402056 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-12237db0-62c9-4f6c-a422-c13de5c8c791 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:27.466212 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-12237db0-62c9-4f6c-a422-c13de5c8c791 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:27.473775 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-12237db0-62c9-4f6c-a422-c13de5c8c791 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 200 len: 1226 microversion: 2.1 time: 0.085143 Jan 28 02:12:27.474415 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 562/1136] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:27 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:27.834973 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-85ea1da4-71b5-470a-896b-930e4df8707c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:27.835873 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-85ea1da4-71b5-470a-896b-930e4df8707c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:27.842273 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-85ea1da4-71b5-470a-896b-930e4df8707c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:27.842713 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-85ea1da4-71b5-470a-896b-930e4df8707c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:27.843474 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-85ea1da4-71b5-470a-896b-930e4df8707c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:27.843905 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-85ea1da4-71b5-470a-896b-930e4df8707c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:27.936806 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-85ea1da4-71b5-470a-896b-930e4df8707c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 14 microversion: 2.1 time: 0.107089 Jan 28 02:12:27.937429 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 575/1137] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:27 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:12:28.490824 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-61e85ab4-be30-4b2f-8f5d-8a14c49e0203 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:28.491430 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-61e85ab4-be30-4b2f-8f5d-8a14c49e0203 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: e0dd16ec-7053-428e-8113-7d7c01cfc067] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:28.497974 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-61e85ab4-be30-4b2f-8f5d-8a14c49e0203 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:28.498420 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-61e85ab4-be30-4b2f-8f5d-8a14c49e0203 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:28.499196 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-61e85ab4-be30-4b2f-8f5d-8a14c49e0203 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:28.499633 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-61e85ab4-be30-4b2f-8f5d-8a14c49e0203 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:28.512970 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-61e85ab4-be30-4b2f-8f5d-8a14c49e0203 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] HTTP exception thrown: Instance e0dd16ec-7053-428e-8113-7d7c01cfc067 could not be found. Jan 28 02:12:28.513562 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-61e85ab4-be30-4b2f-8f5d-8a14c49e0203 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Returning 404 to user: Instance e0dd16ec-7053-428e-8113-7d7c01cfc067 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:12:28.514419 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-61e85ab4-be30-4b2f-8f5d-8a14c49e0203 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067" status: 404 len: 111 microversion: 2.1 time: 0.027755 Jan 28 02:12:28.514968 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 563/1138] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:28 2022] GET /compute/v2.1/servers/e0dd16ec-7053-428e-8113-7d7c01cfc067 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:12:28.949183 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-8601f0c3-6b4a-4840-bcca-794fa5c485bf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:28.950216 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-8601f0c3-6b4a-4840-bcca-794fa5c485bf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:28.957310 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8601f0c3-6b4a-4840-bcca-794fa5c485bf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:28.957774 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8601f0c3-6b4a-4840-bcca-794fa5c485bf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:28.958569 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8601f0c3-6b4a-4840-bcca-794fa5c485bf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:28.959002 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-8601f0c3-6b4a-4840-bcca-794fa5c485bf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:29.048235 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-8601f0c3-6b4a-4840-bcca-794fa5c485bf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 14 microversion: 2.1 time: 0.103546 Jan 28 02:12:29.049024 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 576/1139] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:28 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:12:30.058979 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8200ad62-6ac7-47bb-8924-01f671aa7178 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:30.059883 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8200ad62-6ac7-47bb-8924-01f671aa7178 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:30.065512 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8200ad62-6ac7-47bb-8924-01f671aa7178 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:30.065995 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8200ad62-6ac7-47bb-8924-01f671aa7178 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:30.066768 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8200ad62-6ac7-47bb-8924-01f671aa7178 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:30.067196 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8200ad62-6ac7-47bb-8924-01f671aa7178 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:30.145831 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8200ad62-6ac7-47bb-8924-01f671aa7178 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 14 microversion: 2.1 time: 0.090386 Jan 28 02:12:30.146414 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 564/1140] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:30 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:12:31.156841 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6138ed4e-efa5-4068-bd34-88f11f585f3d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:31.157886 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6138ed4e-efa5-4068-bd34-88f11f585f3d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:31.164246 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6138ed4e-efa5-4068-bd34-88f11f585f3d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:31.164685 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6138ed4e-efa5-4068-bd34-88f11f585f3d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:31.165545 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6138ed4e-efa5-4068-bd34-88f11f585f3d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:31.166003 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6138ed4e-efa5-4068-bd34-88f11f585f3d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:31.261586 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6138ed4e-efa5-4068-bd34-88f11f585f3d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 10009 microversion: 2.1 time: 0.107241 Jan 28 02:12:31.263102 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 577/1141] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:31 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 10009 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:31.587065 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-ca2ea7b8-bb86-4b46-8ff7-66abf75a9051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:31.587641 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ca2ea7b8-bb86-4b46-8ff7-66abf75a9051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:31.590690 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-4af0862a-3b8d-4159-aed0-80717658a56b req-9ee4d04b-cd6a-4b64-b146-2b40bc9d5161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4649f96b-6d9f-42e4-899e-806ed1eec112", "tag": "ad3725b6-3af9-47fd-8f63-1d51eba272ca"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:31.592213 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:31.592213 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:12:31.595470 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ca2ea7b8-bb86-4b46-8ff7-66abf75a9051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:31.596166 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ca2ea7b8-bb86-4b46-8ff7-66abf75a9051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:31.597133 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ca2ea7b8-bb86-4b46-8ff7-66abf75a9051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:31.597736 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-ca2ea7b8-bb86-4b46-8ff7-66abf75a9051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:31.600365 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-4af0862a-3b8d-4159-aed0-80717658a56b req-9ee4d04b-cd6a-4b64-b146-2b40bc9d5161 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:31.600803 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-4af0862a-3b8d-4159-aed0-80717658a56b req-9ee4d04b-cd6a-4b64-b146-2b40bc9d5161 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:31.614780 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-4af0862a-3b8d-4159-aed0-80717658a56b req-9ee4d04b-cd6a-4b64-b146-2b40bc9d5161 service nova] Creating event network-changed:ad3725b6-3af9-47fd-8f63-1d51eba272ca for instance 4649f96b-6d9f-42e4-899e-806ed1eec112 on hv-cinder-82497 Jan 28 02:12:31.619812 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-4af0862a-3b8d-4159-aed0-80717658a56b req-9ee4d04b-cd6a-4b64-b146-2b40bc9d5161 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034445 Jan 28 02:12:31.620628 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 578/1142] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:31.626811 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-ca2ea7b8-bb86-4b46-8ff7-66abf75a9051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:12:31.749688 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-ca2ea7b8-bb86-4b46-8ff7-66abf75a9051 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "DELETE /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 204 len: 0 microversion: 2.1 time: 0.168422 Jan 28 02:12:31.750317 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 565/1143] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:12:31 2022] DELETE /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:12:31.759346 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c18592a5-dac4-4024-ac26-acbd62b1b30c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:31.760336 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c18592a5-dac4-4024-ac26-acbd62b1b30c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:31.767632 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c18592a5-dac4-4024-ac26-acbd62b1b30c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:31.768245 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c18592a5-dac4-4024-ac26-acbd62b1b30c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:31.769109 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c18592a5-dac4-4024-ac26-acbd62b1b30c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:31.769610 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c18592a5-dac4-4024-ac26-acbd62b1b30c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:31.910878 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c18592a5-dac4-4024-ac26-acbd62b1b30c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:31.925843 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c18592a5-dac4-4024-ac26-acbd62b1b30c tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1576 microversion: 2.1 time: 0.170393 Jan 28 02:12:31.927249 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 579/1144] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:31 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:32.277284 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2571ee3e-bb5e-40dc-bbdb-c50fd21daf50 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:32.278314 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2571ee3e-bb5e-40dc-bbdb-c50fd21daf50 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:32.284124 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2571ee3e-bb5e-40dc-bbdb-c50fd21daf50 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:32.284633 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2571ee3e-bb5e-40dc-bbdb-c50fd21daf50 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:32.285431 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2571ee3e-bb5e-40dc-bbdb-c50fd21daf50 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:32.285889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2571ee3e-bb5e-40dc-bbdb-c50fd21daf50 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:32.383891 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2571ee3e-bb5e-40dc-bbdb-c50fd21daf50 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 16782 microversion: 2.1 time: 0.110540 Jan 28 02:12:32.384615 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 566/1145] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:32 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 16782 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:32.943929 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e0ebcf7a-17a2-4c08-b0ee-944891956468 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:32.944539 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e0ebcf7a-17a2-4c08-b0ee-944891956468 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:32.951595 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e0ebcf7a-17a2-4c08-b0ee-944891956468 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:32.952300 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e0ebcf7a-17a2-4c08-b0ee-944891956468 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:32.953107 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e0ebcf7a-17a2-4c08-b0ee-944891956468 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:32.953541 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e0ebcf7a-17a2-4c08-b0ee-944891956468 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:33.077294 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-e0ebcf7a-17a2-4c08-b0ee-944891956468 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:33.084750 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e0ebcf7a-17a2-4c08-b0ee-944891956468 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1457 microversion: 2.1 time: 0.144572 Jan 28 02:12:33.085330 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 580/1146] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:32 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1457 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:33.396961 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-40d93c64-38bf-4b6e-bbdb-89053e8984bc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:33.397996 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-40d93c64-38bf-4b6e-bbdb-89053e8984bc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:33.404496 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-40d93c64-38bf-4b6e-bbdb-89053e8984bc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:33.404935 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-40d93c64-38bf-4b6e-bbdb-89053e8984bc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:33.405820 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-40d93c64-38bf-4b6e-bbdb-89053e8984bc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:33.406243 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-40d93c64-38bf-4b6e-bbdb-89053e8984bc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:33.515907 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-40d93c64-38bf-4b6e-bbdb-89053e8984bc tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 18083 microversion: 2.1 time: 0.122811 Jan 28 02:12:33.516539 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 567/1147] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:33 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 18083 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:12:34.025476 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-03450bec-5ad8-4c9a-8758-1fcc3b61fc6f req-c7a1e05c-fd4e-4f3b-b7a3-a4274090f38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4649f96b-6d9f-42e4-899e-806ed1eec112", "name": "network-vif-deleted", "tag": "ad3725b6-3af9-47fd-8f63-1d51eba272ca"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:34.028030 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:34.028030 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:12:34.036772 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-03450bec-5ad8-4c9a-8758-1fcc3b61fc6f req-c7a1e05c-fd4e-4f3b-b7a3-a4274090f38f service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:34.037243 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-03450bec-5ad8-4c9a-8758-1fcc3b61fc6f req-c7a1e05c-fd4e-4f3b-b7a3-a4274090f38f service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:34.049946 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-03450bec-5ad8-4c9a-8758-1fcc3b61fc6f req-c7a1e05c-fd4e-4f3b-b7a3-a4274090f38f service nova] Creating event network-vif-deleted:ad3725b6-3af9-47fd-8f63-1d51eba272ca for instance 4649f96b-6d9f-42e4-899e-806ed1eec112 on hv-cinder-82497 Jan 28 02:12:34.055957 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-03450bec-5ad8-4c9a-8758-1fcc3b61fc6f req-c7a1e05c-fd4e-4f3b-b7a3-a4274090f38f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033958 Jan 28 02:12:34.056617 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 581/1148] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:12:34.102624 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-640fea7c-9a21-4ba8-a881-ea498bb18fea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:34.103307 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-640fea7c-9a21-4ba8-a881-ea498bb18fea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:34.109708 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-640fea7c-9a21-4ba8-a881-ea498bb18fea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:34.110179 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-640fea7c-9a21-4ba8-a881-ea498bb18fea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:34.110944 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-640fea7c-9a21-4ba8-a881-ea498bb18fea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:34.111366 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-640fea7c-9a21-4ba8-a881-ea498bb18fea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:34.171574 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-640fea7c-9a21-4ba8-a881-ea498bb18fea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac16b6ba0c415da52972cda26bbd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88874e13aa04221b933b43cb2350ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:34.178803 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-640fea7c-9a21-4ba8-a881-ea498bb18fea tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 200 len: 1226 microversion: 2.1 time: 0.080298 Jan 28 02:12:34.179351 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 568/1149] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:34 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:34.528138 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-211fed6f-c76c-4f0d-8e7d-80b17e6833d0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:34.529137 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-211fed6f-c76c-4f0d-8e7d-80b17e6833d0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:34.535213 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-211fed6f-c76c-4f0d-8e7d-80b17e6833d0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:34.535679 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-211fed6f-c76c-4f0d-8e7d-80b17e6833d0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:34.536437 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-211fed6f-c76c-4f0d-8e7d-80b17e6833d0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:34.536864 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-211fed6f-c76c-4f0d-8e7d-80b17e6833d0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:34.643562 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-211fed6f-c76c-4f0d-8e7d-80b17e6833d0 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 20675 microversion: 2.1 time: 0.119273 Jan 28 02:12:34.644351 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 582/1150] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:34 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 20675 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:35.195523 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-18b2762e-1935-4a24-8f56-fecff83a2041 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:35.196121 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-18b2762e-1935-4a24-8f56-fecff83a2041 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 4649f96b-6d9f-42e4-899e-806ed1eec112] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:35.202905 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-18b2762e-1935-4a24-8f56-fecff83a2041 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.203349 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-18b2762e-1935-4a24-8f56-fecff83a2041 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.204181 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-18b2762e-1935-4a24-8f56-fecff83a2041 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.204543 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-18b2762e-1935-4a24-8f56-fecff83a2041 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.218248 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-18b2762e-1935-4a24-8f56-fecff83a2041 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] HTTP exception thrown: Instance 4649f96b-6d9f-42e4-899e-806ed1eec112 could not be found. Jan 28 02:12:35.218828 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-18b2762e-1935-4a24-8f56-fecff83a2041 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Returning 404 to user: Instance 4649f96b-6d9f-42e4-899e-806ed1eec112 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:12:35.219652 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-18b2762e-1935-4a24-8f56-fecff83a2041 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112" status: 404 len: 111 microversion: 2.1 time: 0.027840 Jan 28 02:12:35.220185 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 569/1151] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:35 2022] GET /compute/v2.1/servers/4649f96b-6d9f-42e4-899e-806ed1eec112 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:12:35.656433 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-4ac9c9fc-80e2-4504-909d-3ca2d8a2370e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:35.657732 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-4ac9c9fc-80e2-4504-909d-3ca2d8a2370e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:35.664017 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4ac9c9fc-80e2-4504-909d-3ca2d8a2370e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.664455 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4ac9c9fc-80e2-4504-909d-3ca2d8a2370e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.665224 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4ac9c9fc-80e2-4504-909d-3ca2d8a2370e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.665647 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-4ac9c9fc-80e2-4504-909d-3ca2d8a2370e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.669543 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2e6c271d-180e-412c-9e52-25b0109dc2be tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:35.670068 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2e6c271d-180e-412c-9e52-25b0109dc2be tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:35.675837 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2e6c271d-180e-412c-9e52-25b0109dc2be tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.676277 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2e6c271d-180e-412c-9e52-25b0109dc2be tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.677071 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2e6c271d-180e-412c-9e52-25b0109dc2be tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.677502 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2e6c271d-180e-412c-9e52-25b0109dc2be tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.691011 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-2e6c271d-180e-412c-9e52-25b0109dc2be tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] HTTP exception thrown: Instance 96f81333-d5d4-4278-90ed-540420db8271 could not be found. Jan 28 02:12:35.691596 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2e6c271d-180e-412c-9e52-25b0109dc2be tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Returning 404 to user: Instance 96f81333-d5d4-4278-90ed-540420db8271 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:12:35.692609 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2e6c271d-180e-412c-9e52-25b0109dc2be tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "DELETE /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 404 len: 111 microversion: 2.1 time: 0.026723 Jan 28 02:12:35.693505 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 570/1152] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:12:35 2022] DELETE /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:12:35.701566 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4d1008e9-9eab-4893-b205-1d9df8164cf7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:35.702477 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-4d1008e9-9eab-4893-b205-1d9df8164cf7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] [instance: 96f81333-d5d4-4278-90ed-540420db8271] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:35.708227 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4d1008e9-9eab-4893-b205-1d9df8164cf7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.708668 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4d1008e9-9eab-4893-b205-1d9df8164cf7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.709466 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4d1008e9-9eab-4893-b205-1d9df8164cf7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.709928 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-4d1008e9-9eab-4893-b205-1d9df8164cf7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.723109 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-4d1008e9-9eab-4893-b205-1d9df8164cf7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] HTTP exception thrown: Instance 96f81333-d5d4-4278-90ed-540420db8271 could not be found. Jan 28 02:12:35.723673 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-4d1008e9-9eab-4893-b205-1d9df8164cf7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Returning 404 to user: Instance 96f81333-d5d4-4278-90ed-540420db8271 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:12:35.724470 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-4d1008e9-9eab-4893-b205-1d9df8164cf7 tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271" status: 404 len: 111 microversion: 2.1 time: 0.027036 Jan 28 02:12:35.724974 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 571/1153] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:35 2022] GET /compute/v2.1/servers/96f81333-d5d4-4278-90ed-540420db8271 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:12:35.758503 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-4ac9c9fc-80e2-4504-909d-3ca2d8a2370e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 22854 microversion: 2.1 time: 0.106958 Jan 28 02:12:35.759229 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 583/1154] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:35 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 22854 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:36.770643 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-737e0315-160e-4bbc-aaa2-053fede5bbf5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:36.771623 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-737e0315-160e-4bbc-aaa2-053fede5bbf5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:36.778153 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-737e0315-160e-4bbc-aaa2-053fede5bbf5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:36.778591 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-737e0315-160e-4bbc-aaa2-053fede5bbf5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:36.779344 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-737e0315-160e-4bbc-aaa2-053fede5bbf5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:36.779766 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-737e0315-160e-4bbc-aaa2-053fede5bbf5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:36.879777 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-737e0315-160e-4bbc-aaa2-053fede5bbf5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 24271 microversion: 2.1 time: 0.112596 Jan 28 02:12:36.880705 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 572/1155] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:36 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 24271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:37.011932 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-da284ee4-55ee-4d28-b137-8b82d3e3ca2b tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] Calling method '.version_select at 0x7f08d5b73700>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:37.032977 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-da284ee4-55ee-4d28-b137-8b82d3e3ca2b tempest-TestVolumeBootPattern-1068031418 tempest-TestVolumeBootPattern-1068031418-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1346427623" status: 202 len: 0 microversion: 2.1 time: 0.025502 Jan 28 02:12:37.034236 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 584/1156] 10.222.0.77 () {58 vars in 1262 bytes} [Fri Jan 28 02:12:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1346427623 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:12:37.892735 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-49348c73-15ff-4569-ba2c-26c027a9e9df tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:37.893792 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-49348c73-15ff-4569-ba2c-26c027a9e9df tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:37.900460 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-49348c73-15ff-4569-ba2c-26c027a9e9df tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:37.901540 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-49348c73-15ff-4569-ba2c-26c027a9e9df tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:37.902417 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-49348c73-15ff-4569-ba2c-26c027a9e9df tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:37.902849 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-49348c73-15ff-4569-ba2c-26c027a9e9df tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:38.000306 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-49348c73-15ff-4569-ba2c-26c027a9e9df tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 25932 microversion: 2.1 time: 0.111364 Jan 28 02:12:38.001004 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 573/1157] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:37 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 25932 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:39.012315 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ee2cf61e-c79f-4a0b-bde1-a9acaad7bacd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:39.013461 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ee2cf61e-c79f-4a0b-bde1-a9acaad7bacd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:39.020868 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ee2cf61e-c79f-4a0b-bde1-a9acaad7bacd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:39.021427 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ee2cf61e-c79f-4a0b-bde1-a9acaad7bacd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:39.022428 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ee2cf61e-c79f-4a0b-bde1-a9acaad7bacd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:39.023079 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ee2cf61e-c79f-4a0b-bde1-a9acaad7bacd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:39.120046 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ee2cf61e-c79f-4a0b-bde1-a9acaad7bacd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 27156 microversion: 2.1 time: 0.111224 Jan 28 02:12:39.120702 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 585/1158] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:39 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 27156 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:40.135334 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3708894b-398b-41f1-97f9-61a827f4821b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:40.137000 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3708894b-398b-41f1-97f9-61a827f4821b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:40.150846 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3708894b-398b-41f1-97f9-61a827f4821b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:40.155046 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3708894b-398b-41f1-97f9-61a827f4821b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:40.157272 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3708894b-398b-41f1-97f9-61a827f4821b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:40.158871 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3708894b-398b-41f1-97f9-61a827f4821b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:40.260850 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3708894b-398b-41f1-97f9-61a827f4821b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 27904 microversion: 2.1 time: 0.132046 Jan 28 02:12:40.265427 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 574/1159] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:40 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 27904 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:12:41.273320 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-40fcec02-253f-4b7a-a16f-c96f6cb7a451 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:41.274384 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-40fcec02-253f-4b7a-a16f-c96f6cb7a451 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:41.281185 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-40fcec02-253f-4b7a-a16f-c96f6cb7a451 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:41.281628 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-40fcec02-253f-4b7a-a16f-c96f6cb7a451 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:41.282434 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-40fcec02-253f-4b7a-a16f-c96f6cb7a451 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:41.282977 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-40fcec02-253f-4b7a-a16f-c96f6cb7a451 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:41.374793 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-40fcec02-253f-4b7a-a16f-c96f6cb7a451 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 28274 microversion: 2.1 time: 0.105573 Jan 28 02:12:41.375679 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 586/1160] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:41 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 28274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:42.387955 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-5596bc3f-eeee-47f1-a1a9-92a10108ad92 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:42.390330 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-5596bc3f-eeee-47f1-a1a9-92a10108ad92 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:42.399506 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5596bc3f-eeee-47f1-a1a9-92a10108ad92 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:42.400308 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5596bc3f-eeee-47f1-a1a9-92a10108ad92 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:42.401599 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5596bc3f-eeee-47f1-a1a9-92a10108ad92 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:42.402273 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-5596bc3f-eeee-47f1-a1a9-92a10108ad92 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:42.488608 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-5596bc3f-eeee-47f1-a1a9-92a10108ad92 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 28274 microversion: 2.1 time: 0.105135 Jan 28 02:12:42.489271 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 575/1161] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:42 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 28274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:43.502533 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6186e587-f084-4d6b-9ea3-80a377f0211e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:43.507557 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6186e587-f084-4d6b-9ea3-80a377f0211e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:43.515843 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6186e587-f084-4d6b-9ea3-80a377f0211e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:43.516299 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6186e587-f084-4d6b-9ea3-80a377f0211e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:43.517088 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6186e587-f084-4d6b-9ea3-80a377f0211e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:43.517528 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6186e587-f084-4d6b-9ea3-80a377f0211e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:43.612395 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6186e587-f084-4d6b-9ea3-80a377f0211e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 28565 microversion: 2.1 time: 0.114769 Jan 28 02:12:43.613269 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 587/1162] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:43 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 28565 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:44.624118 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-849d82bf-c13e-4792-b5df-8b0cf73f36c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:44.625111 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-849d82bf-c13e-4792-b5df-8b0cf73f36c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:44.632495 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-849d82bf-c13e-4792-b5df-8b0cf73f36c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:44.632972 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-849d82bf-c13e-4792-b5df-8b0cf73f36c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:44.634054 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-849d82bf-c13e-4792-b5df-8b0cf73f36c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:44.634536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-849d82bf-c13e-4792-b5df-8b0cf73f36c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:44.732653 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-849d82bf-c13e-4792-b5df-8b0cf73f36c6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 28733 microversion: 2.1 time: 0.112360 Jan 28 02:12:44.733221 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 576/1163] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:44 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 28733 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:45.745154 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-9123e4eb-34ab-49e3-86eb-436ad6dd9fc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:45.746161 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-9123e4eb-34ab-49e3-86eb-436ad6dd9fc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:45.752694 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9123e4eb-34ab-49e3-86eb-436ad6dd9fc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:45.753132 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9123e4eb-34ab-49e3-86eb-436ad6dd9fc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:45.753927 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9123e4eb-34ab-49e3-86eb-436ad6dd9fc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:45.754356 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-9123e4eb-34ab-49e3-86eb-436ad6dd9fc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:45.842705 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-9123e4eb-34ab-49e3-86eb-436ad6dd9fc4 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 28733 microversion: 2.1 time: 0.101483 Jan 28 02:12:45.843353 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 588/1164] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:45 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 28733 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:12:46.858250 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-9bc2ad60-7c37-4607-b5e5-3f2640dd3055 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:46.859738 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-9bc2ad60-7c37-4607-b5e5-3f2640dd3055 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:46.868250 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9bc2ad60-7c37-4607-b5e5-3f2640dd3055 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:46.868697 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9bc2ad60-7c37-4607-b5e5-3f2640dd3055 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:46.870345 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9bc2ad60-7c37-4607-b5e5-3f2640dd3055 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:46.870654 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-9bc2ad60-7c37-4607-b5e5-3f2640dd3055 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:46.957468 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-9bc2ad60-7c37-4607-b5e5-3f2640dd3055 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 28733 microversion: 2.1 time: 0.106113 Jan 28 02:12:46.958202 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 577/1165] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:46 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 28733 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:47.969957 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c6958d3a-6101-4031-98c9-7b34ff85a03c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:47.970971 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c6958d3a-6101-4031-98c9-7b34ff85a03c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:47.977460 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c6958d3a-6101-4031-98c9-7b34ff85a03c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:47.977933 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c6958d3a-6101-4031-98c9-7b34ff85a03c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:47.978697 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c6958d3a-6101-4031-98c9-7b34ff85a03c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:47.979121 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c6958d3a-6101-4031-98c9-7b34ff85a03c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:48.081695 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c6958d3a-6101-4031-98c9-7b34ff85a03c tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 28765 microversion: 2.1 time: 0.115554 Jan 28 02:12:48.082364 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 589/1166] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:47 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 28765 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:49.093580 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-aae9c929-3ee6-459d-9f2e-f49e950ee245 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:49.094624 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-aae9c929-3ee6-459d-9f2e-f49e950ee245 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:49.101110 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aae9c929-3ee6-459d-9f2e-f49e950ee245 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:49.101464 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aae9c929-3ee6-459d-9f2e-f49e950ee245 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:49.102307 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aae9c929-3ee6-459d-9f2e-f49e950ee245 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:49.102764 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-aae9c929-3ee6-459d-9f2e-f49e950ee245 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:49.194322 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-aae9c929-3ee6-459d-9f2e-f49e950ee245 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 30987 microversion: 2.1 time: 0.104550 Jan 28 02:12:49.194964 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 578/1167] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:49 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 30987 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:50.206187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-3aa5c85d-61f4-423e-99ab-573c1eb53c24 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:50.207194 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-3aa5c85d-61f4-423e-99ab-573c1eb53c24 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:50.213834 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3aa5c85d-61f4-423e-99ab-573c1eb53c24 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:50.214301 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3aa5c85d-61f4-423e-99ab-573c1eb53c24 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:50.215063 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3aa5c85d-61f4-423e-99ab-573c1eb53c24 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:50.215488 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-3aa5c85d-61f4-423e-99ab-573c1eb53c24 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:50.302718 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-3aa5c85d-61f4-423e-99ab-573c1eb53c24 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 32701 microversion: 2.1 time: 0.100604 Jan 28 02:12:50.303355 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 590/1168] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:50 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 32701 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:51.315417 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-0fc41ec6-e344-46f2-8664-43063164c00f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:51.316421 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-0fc41ec6-e344-46f2-8664-43063164c00f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:51.323230 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0fc41ec6-e344-46f2-8664-43063164c00f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:51.323664 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0fc41ec6-e344-46f2-8664-43063164c00f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:51.324415 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0fc41ec6-e344-46f2-8664-43063164c00f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:51.324835 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-0fc41ec6-e344-46f2-8664-43063164c00f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:51.417676 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-0fc41ec6-e344-46f2-8664-43063164c00f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 33620 microversion: 2.1 time: 0.106104 Jan 28 02:12:51.418334 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 579/1169] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:51 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 33620 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:52.430402 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-662e8b03-b3d6-40d4-9003-4ad6ad455f6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:52.431432 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-662e8b03-b3d6-40d4-9003-4ad6ad455f6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:52.438110 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-662e8b03-b3d6-40d4-9003-4ad6ad455f6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:52.438552 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-662e8b03-b3d6-40d4-9003-4ad6ad455f6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:52.439331 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-662e8b03-b3d6-40d4-9003-4ad6ad455f6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:52.439794 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-662e8b03-b3d6-40d4-9003-4ad6ad455f6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:52.539558 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-662e8b03-b3d6-40d4-9003-4ad6ad455f6e tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 34896 microversion: 2.1 time: 0.112936 Jan 28 02:12:52.540123 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 591/1170] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:52 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 34896 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:53.552637 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-e2d7cf78-2c26-44ef-b137-aa7521b42b70 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:53.553532 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-e2d7cf78-2c26-44ef-b137-aa7521b42b70 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:53.560636 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e2d7cf78-2c26-44ef-b137-aa7521b42b70 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:53.561074 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e2d7cf78-2c26-44ef-b137-aa7521b42b70 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:53.561872 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e2d7cf78-2c26-44ef-b137-aa7521b42b70 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:53.562297 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-e2d7cf78-2c26-44ef-b137-aa7521b42b70 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:53.655205 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-e2d7cf78-2c26-44ef-b137-aa7521b42b70 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 36324 microversion: 2.1 time: 0.106610 Jan 28 02:12:53.655864 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 580/1171] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:53 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 36324 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:54.667725 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-53c27ed0-d1a9-4174-a6f3-82aba8acdea6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:54.668638 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-53c27ed0-d1a9-4174-a6f3-82aba8acdea6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:54.675181 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-53c27ed0-d1a9-4174-a6f3-82aba8acdea6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:54.675627 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-53c27ed0-d1a9-4174-a6f3-82aba8acdea6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:54.676400 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-53c27ed0-d1a9-4174-a6f3-82aba8acdea6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:54.676832 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-53c27ed0-d1a9-4174-a6f3-82aba8acdea6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:54.765818 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-53c27ed0-d1a9-4174-a6f3-82aba8acdea6 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 37895 microversion: 2.1 time: 0.102055 Jan 28 02:12:54.766481 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 592/1172] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:54 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 37895 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:55.778290 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-a8472bc6-87b5-4782-a197-b1909e9c1dfd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:55.779266 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-a8472bc6-87b5-4782-a197-b1909e9c1dfd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:55.785621 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a8472bc6-87b5-4782-a197-b1909e9c1dfd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:55.786074 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a8472bc6-87b5-4782-a197-b1909e9c1dfd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:55.786828 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a8472bc6-87b5-4782-a197-b1909e9c1dfd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:55.787253 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-a8472bc6-87b5-4782-a197-b1909e9c1dfd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:55.891372 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-a8472bc6-87b5-4782-a197-b1909e9c1dfd tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 38268 microversion: 2.1 time: 0.116936 Jan 28 02:12:55.892524 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 581/1173] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:55 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 38268 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:56.904471 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-86af0352-7388-46f7-8851-7cba449afe86 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:56.905452 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-86af0352-7388-46f7-8851-7cba449afe86 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:56.911945 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-86af0352-7388-46f7-8851-7cba449afe86 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:56.912386 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-86af0352-7388-46f7-8851-7cba449afe86 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:56.913153 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-86af0352-7388-46f7-8851-7cba449afe86 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:56.913578 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-86af0352-7388-46f7-8851-7cba449afe86 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:56.994720 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-86af0352-7388-46f7-8851-7cba449afe86 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 38268 microversion: 2.1 time: 0.094551 Jan 28 02:12:56.995370 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 593/1174] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:56 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 38268 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:58.007108 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-45654ef9-418c-4834-87d9-38539ee342f2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:58.008119 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-45654ef9-418c-4834-87d9-38539ee342f2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:58.014556 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-45654ef9-418c-4834-87d9-38539ee342f2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:58.015002 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-45654ef9-418c-4834-87d9-38539ee342f2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:58.015768 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-45654ef9-418c-4834-87d9-38539ee342f2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:58.016201 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-45654ef9-418c-4834-87d9-38539ee342f2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:58.096691 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-45654ef9-418c-4834-87d9-38539ee342f2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 38268 microversion: 2.1 time: 0.093487 Jan 28 02:12:58.097321 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 582/1175] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:58 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 38268 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:59.110817 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-1e5f610a-30be-41cf-9f5f-03b71fc6986b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:59.111848 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-1e5f610a-30be-41cf-9f5f-03b71fc6986b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:59.120296 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1e5f610a-30be-41cf-9f5f-03b71fc6986b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:59.120296 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1e5f610a-30be-41cf-9f5f-03b71fc6986b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:59.120845 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1e5f610a-30be-41cf-9f5f-03b71fc6986b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:59.121274 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-1e5f610a-30be-41cf-9f5f-03b71fc6986b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:59.211753 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-1e5f610a-30be-41cf-9f5f-03b71fc6986b tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action" status: 200 len: 38399 microversion: 2.1 time: 0.105970 Jan 28 02:12:59.212461 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 594/1176] 10.222.0.77 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:59 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/action => generated 38399 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:59.222698 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-6ef25190-cefd-403d-bc53-5b8e3b5960d5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:59.223278 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-6ef25190-cefd-403d-bc53-5b8e3b5960d5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:59.230021 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6ef25190-cefd-403d-bc53-5b8e3b5960d5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:59.230470 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6ef25190-cefd-403d-bc53-5b8e3b5960d5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:59.231244 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6ef25190-cefd-403d-bc53-5b8e3b5960d5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:59.231675 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-6ef25190-cefd-403d-bc53-5b8e3b5960d5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:59.254766 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-6ef25190-cefd-403d-bc53-5b8e3b5960d5 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/ips" status: 200 len: 145 microversion: 2.1 time: 0.036039 Jan 28 02:12:59.255343 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 583/1177] 10.222.0.77 () {58 vars in 1247 bytes} [Fri Jan 28 02:12:59 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:00.582447 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-6b93ef25-334b-4fcb-a2d1-c9028b46abcb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a73b1d9-a6cf-4667-bd60-a6598fb9f2b8"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:13:00.583577 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-6b93ef25-334b-4fcb-a2d1-c9028b46abcb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:00.589957 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6b93ef25-334b-4fcb-a2d1-c9028b46abcb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:00.590408 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6b93ef25-334b-4fcb-a2d1-c9028b46abcb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:00.591175 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6b93ef25-334b-4fcb-a2d1-c9028b46abcb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:00.591607 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-6b93ef25-334b-4fcb-a2d1-c9028b46abcb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:00.832583 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-6b93ef25-334b-4fcb-a2d1-c9028b46abcb tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254014 Jan 28 02:13:00.834066 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 595/1178] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:13:00 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:08.352116 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d2ab3a35-4bd1-4f2f-be3f-01692d8c8f66 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:08.353078 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d2ab3a35-4bd1-4f2f-be3f-01692d8c8f66 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:08.359667 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d2ab3a35-4bd1-4f2f-be3f-01692d8c8f66 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:08.360285 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d2ab3a35-4bd1-4f2f-be3f-01692d8c8f66 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:08.360984 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d2ab3a35-4bd1-4f2f-be3f-01692d8c8f66 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:08.361410 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d2ab3a35-4bd1-4f2f-be3f-01692d8c8f66 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:08.393097 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d2ab3a35-4bd1-4f2f-be3f-01692d8c8f66 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Jan 28 02:13:08.393654 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 584/1179] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:13:08 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:08.409231 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-0ef338cb-d6bb-4ad2-a14e-b052bd56a0ea tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:08.409855 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-0ef338cb-d6bb-4ad2-a14e-b052bd56a0ea tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:08.416829 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ef338cb-d6bb-4ad2-a14e-b052bd56a0ea tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:08.417268 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ef338cb-d6bb-4ad2-a14e-b052bd56a0ea tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:08.418072 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ef338cb-d6bb-4ad2-a14e-b052bd56a0ea tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:08.418500 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-0ef338cb-d6bb-4ad2-a14e-b052bd56a0ea tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:08.448398 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-0ef338cb-d6bb-4ad2-a14e-b052bd56a0ea tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments/8a73b1d9-a6cf-4667-bd60-a6598fb9f2b8" status: 200 len: 194 microversion: 2.1 time: 0.043163 Jan 28 02:13:08.449375 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 596/1180] 10.222.0.77 () {58 vars in 1412 bytes} [Fri Jan 28 02:13:08 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments/8a73b1d9-a6cf-4667-bd60-a6598fb9f2b8 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:09.779742 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d8f51012-2b7f-4fe1-b3d2-2efdc7ba9e36 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67b19e10-9e40-4134-852d-f458253935bc"}} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:13:09.780829 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d8f51012-2b7f-4fe1-b3d2-2efdc7ba9e36 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:09.786749 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d8f51012-2b7f-4fe1-b3d2-2efdc7ba9e36 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:09.787196 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d8f51012-2b7f-4fe1-b3d2-2efdc7ba9e36 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:09.787989 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d8f51012-2b7f-4fe1-b3d2-2efdc7ba9e36 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:09.788417 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d8f51012-2b7f-4fe1-b3d2-2efdc7ba9e36 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:10.048472 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d8f51012-2b7f-4fe1-b3d2-2efdc7ba9e36 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272344 Jan 28 02:13:10.052907 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 585/1181] 10.222.0.77 () {60 vars in 1322 bytes} [Fri Jan 28 02:13:09 2022] POST /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:17.582916 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f1a023d8-3f66-4595-869c-a847fba44781 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:17.583917 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f1a023d8-3f66-4595-869c-a847fba44781 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:17.590357 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f1a023d8-3f66-4595-869c-a847fba44781 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:17.590807 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f1a023d8-3f66-4595-869c-a847fba44781 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:17.591581 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f1a023d8-3f66-4595-869c-a847fba44781 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:17.592014 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f1a023d8-3f66-4595-869c-a847fba44781 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:17.622598 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f1a023d8-3f66-4595-869c-a847fba44781 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043487 Jan 28 02:13:17.623159 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 597/1182] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:13:17 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:17.869523 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2a851f25-a559-4ec6-81ba-be3a60574c84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:17.870107 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2a851f25-a559-4ec6-81ba-be3a60574c84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:17.876234 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2a851f25-a559-4ec6-81ba-be3a60574c84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:17.876676 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2a851f25-a559-4ec6-81ba-be3a60574c84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:17.877462 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2a851f25-a559-4ec6-81ba-be3a60574c84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:17.877936 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2a851f25-a559-4ec6-81ba-be3a60574c84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:17.912289 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2a851f25-a559-4ec6-81ba-be3a60574c84 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments/8a73b1d9-a6cf-4667-bd60-a6598fb9f2b8" status: 200 len: 194 microversion: 2.1 time: 0.047467 Jan 28 02:13:17.912876 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 586/1183] 10.222.0.77 () {58 vars in 1412 bytes} [Fri Jan 28 02:13:17 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments/8a73b1d9-a6cf-4667-bd60-a6598fb9f2b8 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:17.924744 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d89dedcf-1855-4ef9-a98f-8994112c5b4f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:17.926379 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d89dedcf-1855-4ef9-a98f-8994112c5b4f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:17.932579 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d89dedcf-1855-4ef9-a98f-8994112c5b4f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:17.933022 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d89dedcf-1855-4ef9-a98f-8994112c5b4f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:17.933823 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d89dedcf-1855-4ef9-a98f-8994112c5b4f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:17.934360 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d89dedcf-1855-4ef9-a98f-8994112c5b4f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:18.022713 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-d89dedcf-1855-4ef9-a98f-8994112c5b4f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lazy-loading 'services' on Instance uuid c6390bcd-db15-4165-812c-b638fceaa5be {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:13:18.094954 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d89dedcf-1855-4ef9-a98f-8994112c5b4f tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments/8a73b1d9-a6cf-4667-bd60-a6598fb9f2b8" status: 202 len: 0 microversion: 2.1 time: 0.175250 Jan 28 02:13:18.095588 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 598/1184] 10.222.0.77 () {58 vars in 1415 bytes} [Fri Jan 28 02:13:17 2022] DELETE /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments/8a73b1d9-a6cf-4667-bd60-a6598fb9f2b8 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:13:19.216447 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-8f7ca327-18fb-4ae2-9662-b292b907a478 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:19.217142 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-8f7ca327-18fb-4ae2-9662-b292b907a478 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:19.222959 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f7ca327-18fb-4ae2-9662-b292b907a478 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:19.223419 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f7ca327-18fb-4ae2-9662-b292b907a478 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:19.224211 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f7ca327-18fb-4ae2-9662-b292b907a478 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:19.224639 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-8f7ca327-18fb-4ae2-9662-b292b907a478 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:19.256306 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-8f7ca327-18fb-4ae2-9662-b292b907a478 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments/67b19e10-9e40-4134-852d-f458253935bc" status: 200 len: 194 microversion: 2.1 time: 0.043758 Jan 28 02:13:19.256921 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 587/1185] 10.222.0.77 () {58 vars in 1412 bytes} [Fri Jan 28 02:13:19 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments/67b19e10-9e40-4134-852d-f458253935bc => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:19.268009 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-e9288adf-72d5-4162-8dc8-06d29af41a19 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:19.269917 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-e9288adf-72d5-4162-8dc8-06d29af41a19 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:19.276941 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e9288adf-72d5-4162-8dc8-06d29af41a19 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:19.277377 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e9288adf-72d5-4162-8dc8-06d29af41a19 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:19.278195 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e9288adf-72d5-4162-8dc8-06d29af41a19 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:19.278630 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-e9288adf-72d5-4162-8dc8-06d29af41a19 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:19.371305 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.objects.instance [None req-e9288adf-72d5-4162-8dc8-06d29af41a19 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lazy-loading 'services' on Instance uuid c6390bcd-db15-4165-812c-b638fceaa5be {{(pid=115761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:13:19.438962 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-e9288adf-72d5-4162-8dc8-06d29af41a19 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments/67b19e10-9e40-4134-852d-f458253935bc" status: 202 len: 0 microversion: 2.1 time: 0.175800 Jan 28 02:13:19.439534 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 599/1186] 10.222.0.77 () {58 vars in 1415 bytes} [Fri Jan 28 02:13:19 2022] DELETE /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments/67b19e10-9e40-4134-852d-f458253935bc => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:13:20.620455 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-799d81f4-30f2-4bf9-bd90-391cfa702cb2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:20.621354 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-799d81f4-30f2-4bf9-bd90-391cfa702cb2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:20.628258 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-799d81f4-30f2-4bf9-bd90-391cfa702cb2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:20.628695 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-799d81f4-30f2-4bf9-bd90-391cfa702cb2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:20.629467 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-799d81f4-30f2-4bf9-bd90-391cfa702cb2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:20.629930 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-799d81f4-30f2-4bf9-bd90-391cfa702cb2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:20.658976 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-799d81f4-30f2-4bf9-bd90-391cfa702cb2 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042777 Jan 28 02:13:20.659535 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 588/1187] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:13:20 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:13:20.775823 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-50544623-a936-4052-aa2f-05620bce6515 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:20.776824 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-50544623-a936-4052-aa2f-05620bce6515 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:20.783129 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-50544623-a936-4052-aa2f-05620bce6515 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:20.783517 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-50544623-a936-4052-aa2f-05620bce6515 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:20.784328 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-50544623-a936-4052-aa2f-05620bce6515 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:20.784756 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-50544623-a936-4052-aa2f-05620bce6515 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:20.814574 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-50544623-a936-4052-aa2f-05620bce6515 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043345 Jan 28 02:13:20.815141 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 600/1188] 10.222.0.77 () {58 vars in 1301 bytes} [Fri Jan 28 02:13:20 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:13:20.877833 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-26528894-6199-4d11-856b-f6f17ac2bbff tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:20.878318 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-26528894-6199-4d11-856b-f6f17ac2bbff tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:20.884249 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26528894-6199-4d11-856b-f6f17ac2bbff tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:20.884714 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26528894-6199-4d11-856b-f6f17ac2bbff tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:20.885491 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26528894-6199-4d11-856b-f6f17ac2bbff tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:20.885964 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26528894-6199-4d11-856b-f6f17ac2bbff tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:20.911087 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-26528894-6199-4d11-856b-f6f17ac2bbff tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:13:20.988219 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-26528894-6199-4d11-856b-f6f17ac2bbff tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 204 len: 0 microversion: 2.1 time: 0.113729 Jan 28 02:13:20.988887 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 589/1189] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:13:20 2022] DELETE /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:13:20.997457 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-72654186-8fb5-4d02-b27b-978e607a2411 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:20.999848 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-72654186-8fb5-4d02-b27b-978e607a2411 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:21.004519 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-72654186-8fb5-4d02-b27b-978e607a2411 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:21.004967 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-72654186-8fb5-4d02-b27b-978e607a2411 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:21.005766 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-72654186-8fb5-4d02-b27b-978e607a2411 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:21.006212 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-72654186-8fb5-4d02-b27b-978e607a2411 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:21.138599 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-72654186-8fb5-4d02-b27b-978e607a2411 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:21.146118 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-72654186-8fb5-4d02-b27b-978e607a2411 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1672 microversion: 2.1 time: 0.152505 Jan 28 02:13:21.146899 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 601/1190] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:20 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:22.164315 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-213c6e89-224e-471b-a8b0-0b5747c8d8e7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:22.164994 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-213c6e89-224e-471b-a8b0-0b5747c8d8e7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:22.170813 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-213c6e89-224e-471b-a8b0-0b5747c8d8e7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:22.171249 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-213c6e89-224e-471b-a8b0-0b5747c8d8e7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:22.171999 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-213c6e89-224e-471b-a8b0-0b5747c8d8e7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:22.172420 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-213c6e89-224e-471b-a8b0-0b5747c8d8e7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:22.301367 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-213c6e89-224e-471b-a8b0-0b5747c8d8e7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:22.314299 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-213c6e89-224e-471b-a8b0-0b5747c8d8e7 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1672 microversion: 2.1 time: 0.153624 Jan 28 02:13:22.314906 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 590/1191] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:22 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:23.332877 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c6204d02-6ce8-45e4-8a56-d5cbaf844adf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:23.333480 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c6204d02-6ce8-45e4-8a56-d5cbaf844adf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:23.340507 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c6204d02-6ce8-45e4-8a56-d5cbaf844adf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:23.340957 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c6204d02-6ce8-45e4-8a56-d5cbaf844adf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:23.341817 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c6204d02-6ce8-45e4-8a56-d5cbaf844adf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:23.342259 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c6204d02-6ce8-45e4-8a56-d5cbaf844adf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:23.486292 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-c6204d02-6ce8-45e4-8a56-d5cbaf844adf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d0c28025a44aa3a9f5cfca4d91070c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:23.494718 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c6204d02-6ce8-45e4-8a56-d5cbaf844adf tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 200 len: 1672 microversion: 2.1 time: 0.165224 Jan 28 02:13:23.495948 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 602/1192] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:23 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:23.818237 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-d845ae87-f2b6-4554-8bb0-96d378fd03c0 req-0ecfbf37-7ee1-4de9-ba64-a7b43452e102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6390bcd-db15-4165-812c-b638fceaa5be", "name": "network-vif-deleted", "tag": "1dbf75e2-16c1-4f57-99d5-c77559ce1033"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:13:23.819962 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:13:23.819962 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:13:23.827640 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-d845ae87-f2b6-4554-8bb0-96d378fd03c0 req-0ecfbf37-7ee1-4de9-ba64-a7b43452e102 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:23.828070 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-d845ae87-f2b6-4554-8bb0-96d378fd03c0 req-0ecfbf37-7ee1-4de9-ba64-a7b43452e102 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:23.838917 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-d845ae87-f2b6-4554-8bb0-96d378fd03c0 req-0ecfbf37-7ee1-4de9-ba64-a7b43452e102 service nova] Creating event network-vif-deleted:1dbf75e2-16c1-4f57-99d5-c77559ce1033 for instance c6390bcd-db15-4165-812c-b638fceaa5be on hv-cinder-82497 Jan 28 02:13:23.844337 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-d845ae87-f2b6-4554-8bb0-96d378fd03c0 req-0ecfbf37-7ee1-4de9-ba64-a7b43452e102 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029469 Jan 28 02:13:23.845235 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 591/1193] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:24.514604 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-13bcdbd6-a5e3-474a-9131-d339f9df9a60 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:24.514604 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-13bcdbd6-a5e3-474a-9131-d339f9df9a60 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:24.521663 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-13bcdbd6-a5e3-474a-9131-d339f9df9a60 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:24.522135 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-13bcdbd6-a5e3-474a-9131-d339f9df9a60 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:24.522946 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-13bcdbd6-a5e3-474a-9131-d339f9df9a60 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:24.523856 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-13bcdbd6-a5e3-474a-9131-d339f9df9a60 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:24.538064 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-13bcdbd6-a5e3-474a-9131-d339f9df9a60 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] HTTP exception thrown: Instance c6390bcd-db15-4165-812c-b638fceaa5be could not be found. Jan 28 02:13:24.538653 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-13bcdbd6-a5e3-474a-9131-d339f9df9a60 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Returning 404 to user: Instance c6390bcd-db15-4165-812c-b638fceaa5be could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:24.540054 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-13bcdbd6-a5e3-474a-9131-d339f9df9a60 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 404 len: 111 microversion: 2.1 time: 0.030177 Jan 28 02:13:24.540615 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 603/1194] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:24 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:13:24.549364 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d2d21c00-9c01-4512-be8e-ca32b0c60410 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '.version_select at 0x7f08d7b3c700>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:24.570929 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d2d21c00-9c01-4512-be8e-ca32b0c60410 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534110585" status: 202 len: 0 microversion: 2.1 time: 0.025500 Jan 28 02:13:24.571613 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 592/1195] 10.222.0.77 () {58 vars in 1220 bytes} [Fri Jan 28 02:13:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534110585 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:13:27.475487 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ab98b9f8-c4cd-4466-8959-d06d112fbeb9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:27.475985 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-ab98b9f8-c4cd-4466-8959-d06d112fbeb9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:27.481764 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ab98b9f8-c4cd-4466-8959-d06d112fbeb9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:27.482217 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ab98b9f8-c4cd-4466-8959-d06d112fbeb9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:27.482987 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ab98b9f8-c4cd-4466-8959-d06d112fbeb9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:27.483426 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-ab98b9f8-c4cd-4466-8959-d06d112fbeb9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:27.496552 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-ab98b9f8-c4cd-4466-8959-d06d112fbeb9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] HTTP exception thrown: Instance c6390bcd-db15-4165-812c-b638fceaa5be could not be found. Jan 28 02:13:27.497130 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-ab98b9f8-c4cd-4466-8959-d06d112fbeb9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Returning 404 to user: Instance c6390bcd-db15-4165-812c-b638fceaa5be could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:27.497979 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-ab98b9f8-c4cd-4466-8959-d06d112fbeb9 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "DELETE /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 404 len: 111 microversion: 2.1 time: 0.026123 Jan 28 02:13:27.498493 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 604/1196] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:13:27 2022] DELETE /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:13:27.506632 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2d793ab5-bb4e-495a-8404-53eea556cb33 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:27.507338 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-2d793ab5-bb4e-495a-8404-53eea556cb33 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: c6390bcd-db15-4165-812c-b638fceaa5be] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:27.514182 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2d793ab5-bb4e-495a-8404-53eea556cb33 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:27.514624 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2d793ab5-bb4e-495a-8404-53eea556cb33 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:27.515393 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2d793ab5-bb4e-495a-8404-53eea556cb33 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:27.515809 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-2d793ab5-bb4e-495a-8404-53eea556cb33 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:27.529230 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-2d793ab5-bb4e-495a-8404-53eea556cb33 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] HTTP exception thrown: Instance c6390bcd-db15-4165-812c-b638fceaa5be could not be found. Jan 28 02:13:27.529739 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-2d793ab5-bb4e-495a-8404-53eea556cb33 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Returning 404 to user: Instance c6390bcd-db15-4165-812c-b638fceaa5be could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:27.530617 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-2d793ab5-bb4e-495a-8404-53eea556cb33 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be" status: 404 len: 111 microversion: 2.1 time: 0.028167 Jan 28 02:13:27.531159 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 593/1197] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:27 2022] GET /compute/v2.1/servers/c6390bcd-db15-4165-812c-b638fceaa5be => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:13:28.663746 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c84d2c26-7de8-4b66-99ba-c27fa5c619e1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:28.664319 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-c84d2c26-7de8-4b66-99ba-c27fa5c619e1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:28.670319 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c84d2c26-7de8-4b66-99ba-c27fa5c619e1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:28.670758 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c84d2c26-7de8-4b66-99ba-c27fa5c619e1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:28.671534 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c84d2c26-7de8-4b66-99ba-c27fa5c619e1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:28.671959 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-c84d2c26-7de8-4b66-99ba-c27fa5c619e1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:28.685393 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-c84d2c26-7de8-4b66-99ba-c27fa5c619e1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] HTTP exception thrown: Instance 390009be-47d1-4368-93a3-f95c9c81ef18 could not be found. Jan 28 02:13:28.686008 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-c84d2c26-7de8-4b66-99ba-c27fa5c619e1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Returning 404 to user: Instance 390009be-47d1-4368-93a3-f95c9c81ef18 could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:28.686840 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-c84d2c26-7de8-4b66-99ba-c27fa5c619e1 tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "DELETE /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 404 len: 111 microversion: 2.1 time: 0.026784 Jan 28 02:13:28.687384 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 605/1198] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:13:28 2022] DELETE /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:13:28.695889 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-65fe847e-be01-4c65-b37d-0cf9c49a148d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:28.696484 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-65fe847e-be01-4c65-b37d-0cf9c49a148d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] [instance: 390009be-47d1-4368-93a3-f95c9c81ef18] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:28.702618 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-65fe847e-be01-4c65-b37d-0cf9c49a148d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:28.703052 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-65fe847e-be01-4c65-b37d-0cf9c49a148d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:28.703812 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-65fe847e-be01-4c65-b37d-0cf9c49a148d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:28.704238 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-65fe847e-be01-4c65-b37d-0cf9c49a148d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:28.718761 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.wsgi [None req-65fe847e-be01-4c65-b37d-0cf9c49a148d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] HTTP exception thrown: Instance 390009be-47d1-4368-93a3-f95c9c81ef18 could not be found. Jan 28 02:13:28.719343 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-65fe847e-be01-4c65-b37d-0cf9c49a148d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] Returning 404 to user: Instance 390009be-47d1-4368-93a3-f95c9c81ef18 could not be found. {{(pid=115760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:28.720167 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-65fe847e-be01-4c65-b37d-0cf9c49a148d tempest-AttachVolumeTestJSON-587117509 tempest-AttachVolumeTestJSON-587117509-project] 10.222.0.77 "GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18" status: 404 len: 111 microversion: 2.1 time: 0.028553 Jan 28 02:13:28.720715 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 594/1199] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:28 2022] GET /compute/v2.1/servers/390009be-47d1-4368-93a3-f95c9c81ef18 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:14:04.647187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1410051695", "imageRef": "51201cf9-5e9a-482b-be83-568bdfd019b1", "flavorRef": "452"}} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:04.697341 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.network.neutron [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] validate_networks() for None {{(pid=115761) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:14:04.980187 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Flavor limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:14:04.980609 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Image limits 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:14:04.981091 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Flavor pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:14:04.981494 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Image pref 0:0:0 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:14:04.981947 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.virt.hardware [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:14:04.991931 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:04.992380 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:04.993192 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:04.993626 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:05.013484 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Getting quotas for project 59ec37357d6747958f269b0c68fba132. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:14:05.017678 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.quota [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Getting quotas for user 44e1ee4537264fe89d075c1a6b991df9 and project 59ec37357d6747958f269b0c68fba132. Resources: {'cores', 'ram', 'instances'} {{(pid=115761) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:14:05.029094 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Going to run 1 instances... {{(pid=115761) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:14:05.031481 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51201cf9-5e9a-482b-be83-568bdfd019b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:14:05.078888 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-cbc9e2d2-8b6c-4ce7-8f47-5f887b7a5429 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.435865 Jan 28 02:14:05.079524 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 606/1200] 10.222.0.77 () {60 vars in 1146 bytes} [Fri Jan 28 02:14:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:14:05.090124 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-c3548282-35a9-4392-b772-6177a11ed635 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:05.090762 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-c3548282-35a9-4392-b772-6177a11ed635 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:05.143942 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-c3548282-35a9-4392-b772-6177a11ed635 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:05.151032 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-c3548282-35a9-4392-b772-6177a11ed635 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1215 microversion: 2.1 time: 0.064637 Jan 28 02:14:05.151595 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 595/1201] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:05 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:06.168963 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-950e3371-6229-41e4-ab36-787db36e3b4f tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:06.170314 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-950e3371-6229-41e4-ab36-787db36e3b4f tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:06.176777 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-950e3371-6229-41e4-ab36-787db36e3b4f tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:06.177831 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-950e3371-6229-41e4-ab36-787db36e3b4f tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:06.178735 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-950e3371-6229-41e4-ab36-787db36e3b4f tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:06.179162 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-950e3371-6229-41e4-ab36-787db36e3b4f tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:06.246962 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-950e3371-6229-41e4-ab36-787db36e3b4f tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:06.254913 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-950e3371-6229-41e4-ab36-787db36e3b4f tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1275 microversion: 2.1 time: 0.089867 Jan 28 02:14:06.255822 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 607/1202] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:06 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:07.273422 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-112ee25b-a42f-4113-a331-1d353f650956 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:07.274069 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-112ee25b-a42f-4113-a331-1d353f650956 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:07.279963 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-112ee25b-a42f-4113-a331-1d353f650956 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:07.280336 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-112ee25b-a42f-4113-a331-1d353f650956 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:07.281107 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-112ee25b-a42f-4113-a331-1d353f650956 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:07.281527 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-112ee25b-a42f-4113-a331-1d353f650956 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:07.408290 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-112ee25b-a42f-4113-a331-1d353f650956 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:07.416035 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-112ee25b-a42f-4113-a331-1d353f650956 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1315 microversion: 2.1 time: 0.147515 Jan 28 02:14:07.416805 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 596/1203] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:07 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:07.723053 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-174a4756-c24b-4bd3-90c8-09ca74438229 req-34076592-f7b7-4595-8197-e652f12b97d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d250aae-2844-46c3-bd51-e2a5330d9b6e", "tag": "d08b2a86-a92e-414b-93b9-248478b17d93"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:07.726212 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:07.726212 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:14:07.742150 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-174a4756-c24b-4bd3-90c8-09ca74438229 req-34076592-f7b7-4595-8197-e652f12b97d4 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:07.742591 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-174a4756-c24b-4bd3-90c8-09ca74438229 req-34076592-f7b7-4595-8197-e652f12b97d4 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:07.762439 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-174a4756-c24b-4bd3-90c8-09ca74438229 req-34076592-f7b7-4595-8197-e652f12b97d4 service nova] Creating event network-changed:d08b2a86-a92e-414b-93b9-248478b17d93 for instance 4d250aae-2844-46c3-bd51-e2a5330d9b6e on hv-cinder-82497 Jan 28 02:14:07.768071 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-174a4756-c24b-4bd3-90c8-09ca74438229 req-34076592-f7b7-4595-8197-e652f12b97d4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051821 Jan 28 02:14:07.768914 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 608/1204] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:14:08.432378 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-26f77271-6a2a-4e0f-b7c6-a200bc81a64a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:08.432969 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-26f77271-6a2a-4e0f-b7c6-a200bc81a64a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:08.439043 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26f77271-6a2a-4e0f-b7c6-a200bc81a64a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:08.439483 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26f77271-6a2a-4e0f-b7c6-a200bc81a64a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:08.440254 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26f77271-6a2a-4e0f-b7c6-a200bc81a64a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:08.440685 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-26f77271-6a2a-4e0f-b7c6-a200bc81a64a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:08.585359 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-26f77271-6a2a-4e0f-b7c6-a200bc81a64a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:08.592821 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-26f77271-6a2a-4e0f-b7c6-a200bc81a64a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1315 microversion: 2.1 time: 0.164130 Jan 28 02:14:08.593383 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 597/1205] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:08 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:09.610199 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-70dd2a58-b594-4e95-9381-9927ed5ef37d tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:09.610794 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-70dd2a58-b594-4e95-9381-9927ed5ef37d tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:09.617076 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-70dd2a58-b594-4e95-9381-9927ed5ef37d tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:09.617508 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-70dd2a58-b594-4e95-9381-9927ed5ef37d tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:09.618294 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-70dd2a58-b594-4e95-9381-9927ed5ef37d tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:09.618717 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-70dd2a58-b594-4e95-9381-9927ed5ef37d tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:09.741248 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-70dd2a58-b594-4e95-9381-9927ed5ef37d tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:09.748663 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-70dd2a58-b594-4e95-9381-9927ed5ef37d tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1315 microversion: 2.1 time: 0.142642 Jan 28 02:14:09.749233 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 609/1206] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:09 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:10.765413 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-15808f9e-4b52-419e-9e99-32c4cc153502 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:10.766156 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-15808f9e-4b52-419e-9e99-32c4cc153502 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:10.772074 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-15808f9e-4b52-419e-9e99-32c4cc153502 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:10.772518 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-15808f9e-4b52-419e-9e99-32c4cc153502 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:10.773292 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-15808f9e-4b52-419e-9e99-32c4cc153502 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:10.773718 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-15808f9e-4b52-419e-9e99-32c4cc153502 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:10.908841 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-15808f9e-4b52-419e-9e99-32c4cc153502 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:10.919190 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-15808f9e-4b52-419e-9e99-32c4cc153502 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1315 microversion: 2.1 time: 0.157275 Jan 28 02:14:10.919814 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 598/1207] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:10 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:11.936328 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-18582d22-b26f-4317-a917-2ee5af9f0f6c tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:11.936932 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-18582d22-b26f-4317-a917-2ee5af9f0f6c tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:11.942874 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-18582d22-b26f-4317-a917-2ee5af9f0f6c tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:11.943321 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-18582d22-b26f-4317-a917-2ee5af9f0f6c tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:11.944090 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-18582d22-b26f-4317-a917-2ee5af9f0f6c tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:11.944517 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-18582d22-b26f-4317-a917-2ee5af9f0f6c tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:12.072009 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-18582d22-b26f-4317-a917-2ee5af9f0f6c tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:12.079615 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-18582d22-b26f-4317-a917-2ee5af9f0f6c tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1315 microversion: 2.1 time: 0.146926 Jan 28 02:14:12.080174 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 610/1208] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:11 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:13.020481 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [req-2705c5da-0742-46d2-8bb8-b0d0095a2d55 req-db674201-9174-43cb-91f9-86a320168a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d250aae-2844-46c3-bd51-e2a5330d9b6e", "name": "network-vif-plugged", "status": "completed", "tag": "d08b2a86-a92e-414b-93b9-248478b17d93"}]} {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:13.023310 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:13.023310 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: warnings.warn(msg) Jan 28 02:14:13.033020 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-2705c5da-0742-46d2-8bb8-b0d0095a2d55 req-db674201-9174-43cb-91f9-86a320168a67 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:13.033714 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [req-2705c5da-0742-46d2-8bb8-b0d0095a2d55 req-db674201-9174-43cb-91f9-86a320168a67 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:13.048936 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.compute.server_external_events [req-2705c5da-0742-46d2-8bb8-b0d0095a2d55 req-db674201-9174-43cb-91f9-86a320168a67 service nova] Creating event network-vif-plugged:d08b2a86-a92e-414b-93b9-248478b17d93 for instance 4d250aae-2844-46c3-bd51-e2a5330d9b6e on hv-cinder-82497 Jan 28 02:14:13.054565 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [req-2705c5da-0742-46d2-8bb8-b0d0095a2d55 req-db674201-9174-43cb-91f9-86a320168a67 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164786 Jan 28 02:14:13.055146 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 599/1209] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:14:13.096312 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-d3038d77-3c59-474c-9696-dfdfb0e298ed tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:13.096975 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-d3038d77-3c59-474c-9696-dfdfb0e298ed tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:13.104278 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d3038d77-3c59-474c-9696-dfdfb0e298ed tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:13.104850 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d3038d77-3c59-474c-9696-dfdfb0e298ed tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:13.105656 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d3038d77-3c59-474c-9696-dfdfb0e298ed tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:13.106264 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-d3038d77-3c59-474c-9696-dfdfb0e298ed tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:13.233302 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-d3038d77-3c59-474c-9696-dfdfb0e298ed tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:13.241618 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-d3038d77-3c59-474c-9696-dfdfb0e298ed tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1315 microversion: 2.1 time: 0.149096 Jan 28 02:14:13.242283 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 611/1210] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:13 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:14.259416 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-38b2921c-3a1c-44a8-a81c-b18f1d5d6550 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:14.260210 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-38b2921c-3a1c-44a8-a81c-b18f1d5d6550 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:14.266468 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-38b2921c-3a1c-44a8-a81c-b18f1d5d6550 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:14.266906 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-38b2921c-3a1c-44a8-a81c-b18f1d5d6550 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:14.267688 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-38b2921c-3a1c-44a8-a81c-b18f1d5d6550 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:14.268112 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-38b2921c-3a1c-44a8-a81c-b18f1d5d6550 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:14.396406 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-38b2921c-3a1c-44a8-a81c-b18f1d5d6550 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:14.407025 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-38b2921c-3a1c-44a8-a81c-b18f1d5d6550 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1315 microversion: 2.1 time: 0.151911 Jan 28 02:14:14.412536 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 600/1211] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:14 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:15.423723 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-28be5243-6ae1-48e6-8521-c5aa7a4d67bc tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:15.424329 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-28be5243-6ae1-48e6-8521-c5aa7a4d67bc tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:15.430894 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-28be5243-6ae1-48e6-8521-c5aa7a4d67bc tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:15.431335 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-28be5243-6ae1-48e6-8521-c5aa7a4d67bc tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:15.432100 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-28be5243-6ae1-48e6-8521-c5aa7a4d67bc tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:15.432521 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-28be5243-6ae1-48e6-8521-c5aa7a4d67bc tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:15.564669 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-28be5243-6ae1-48e6-8521-c5aa7a4d67bc tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:15.572152 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-28be5243-6ae1-48e6-8521-c5aa7a4d67bc tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1465 microversion: 2.1 time: 0.152704 Jan 28 02:14:15.572719 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 612/1212] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:15 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1465 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:15.609296 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-d0cae27a-d8a9-4b81-bfe0-84e5140e7934 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:15.609873 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d0cae27a-d8a9-4b81-bfe0-84e5140e7934 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:15.615781 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d0cae27a-d8a9-4b81-bfe0-84e5140e7934 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:15.616222 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d0cae27a-d8a9-4b81-bfe0-84e5140e7934 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:15.616991 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d0cae27a-d8a9-4b81-bfe0-84e5140e7934 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:15.617421 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-d0cae27a-d8a9-4b81-bfe0-84e5140e7934 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:15.642036 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-d0cae27a-d8a9-4b81-bfe0-84e5140e7934 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Going to try to terminate instance {{(pid=115760) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:14:15.722955 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-d0cae27a-d8a9-4b81-bfe0-84e5140e7934 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "DELETE /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 204 len: 0 microversion: 2.1 time: 0.116652 Jan 28 02:14:15.723702 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 601/1213] 10.222.0.77 () {58 vars in 1238 bytes} [Fri Jan 28 02:14:15 2022] DELETE /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:14:15.732198 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-f691102b-7efd-4e01-a481-61e27a3219d6 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:15.732844 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-f691102b-7efd-4e01-a481-61e27a3219d6 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:15.738804 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f691102b-7efd-4e01-a481-61e27a3219d6 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:15.739244 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f691102b-7efd-4e01-a481-61e27a3219d6 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:15.740007 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f691102b-7efd-4e01-a481-61e27a3219d6 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:15.740427 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-f691102b-7efd-4e01-a481-61e27a3219d6 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:15.866393 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.policy [None req-f691102b-7efd-4e01-a481-61e27a3219d6 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115761) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:15.873947 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-f691102b-7efd-4e01-a481-61e27a3219d6 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1471 microversion: 2.1 time: 0.145306 Jan 28 02:14:15.874527 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 613/1214] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:15 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:16.892319 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-fd84faf5-b5ec-4ed9-b28f-36ee97859e4a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:16.893001 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-fd84faf5-b5ec-4ed9-b28f-36ee97859e4a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:16.899592 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fd84faf5-b5ec-4ed9-b28f-36ee97859e4a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:16.900027 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fd84faf5-b5ec-4ed9-b28f-36ee97859e4a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:16.900862 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fd84faf5-b5ec-4ed9-b28f-36ee97859e4a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:16.901280 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-fd84faf5-b5ec-4ed9-b28f-36ee97859e4a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:17.023942 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-fd84faf5-b5ec-4ed9-b28f-36ee97859e4a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:17.031299 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-fd84faf5-b5ec-4ed9-b28f-36ee97859e4a tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1471 microversion: 2.1 time: 0.142957 Jan 28 02:14:17.031873 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 602/1215] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:16 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1471 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:17.781114 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [req-eb4410d5-a00f-450d-ade2-57038bf154eb req-26aae771-093e-4b53-94c2-302911e63db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d250aae-2844-46c3-bd51-e2a5330d9b6e", "name": "network-vif-deleted", "tag": "d08b2a86-a92e-414b-93b9-248478b17d93"}]} {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:17.787064 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:17.787064 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: warnings.warn(msg) Jan 28 02:14:17.795173 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-eb4410d5-a00f-450d-ade2-57038bf154eb req-26aae771-093e-4b53-94c2-302911e63db7 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:17.795667 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [req-eb4410d5-a00f-450d-ade2-57038bf154eb req-26aae771-093e-4b53-94c2-302911e63db7 service nova] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:17.807671 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.compute.server_external_events [req-eb4410d5-a00f-450d-ade2-57038bf154eb req-26aae771-093e-4b53-94c2-302911e63db7 service nova] Creating event network-vif-deleted:d08b2a86-a92e-414b-93b9-248478b17d93 for instance 4d250aae-2844-46c3-bd51-e2a5330d9b6e on hv-cinder-82497 Jan 28 02:14:17.813313 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [req-eb4410d5-a00f-450d-ade2-57038bf154eb req-26aae771-093e-4b53-94c2-302911e63db7 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035661 Jan 28 02:14:17.814378 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 614/1216] 10.222.0.77 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:14:18.048346 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.api.openstack.wsgi [None req-3f073882-1fc7-4c08-8dd8-0b39ea508215 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:18.048892 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.compute.api [None req-3f073882-1fc7-4c08-8dd8-0b39ea508215 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115760) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:18.054909 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3f073882-1fc7-4c08-8dd8-0b39ea508215 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:18.055357 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3f073882-1fc7-4c08-8dd8-0b39ea508215 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:18.056132 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3f073882-1fc7-4c08-8dd8-0b39ea508215 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:18.056561 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3f073882-1fc7-4c08-8dd8-0b39ea508215 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:18.089041 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3f073882-1fc7-4c08-8dd8-0b39ea508215 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:18.089480 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG oslo_concurrency.lockutils [None req-3f073882-1fc7-4c08-8dd8-0b39ea508215 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:18.089964 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.objects.instance [None req-3f073882-1fc7-4c08-8dd8-0b39ea508215 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lazy-loading 'fault' on Instance uuid 4d250aae-2844-46c3-bd51-e2a5330d9b6e {{(pid=115760) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:14:18.129218 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: DEBUG nova.policy [None req-3f073882-1fc7-4c08-8dd8-0b39ea508215 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e1ee4537264fe89d075c1a6b991df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ec37357d6747958f269b0c68fba132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115760) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:18.138755 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO nova.api.openstack.requestlog [None req-3f073882-1fc7-4c08-8dd8-0b39ea508215 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 200 len: 1305 microversion: 2.1 time: 0.094276 Jan 28 02:14:18.139354 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: [pid: 115760|app: 0|req: 603/1217] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:18 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:19.162584 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-cae76eb5-3d0f-4a23-9a1d-f6c7a256d116 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Calling method '>' {{(pid=115761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:19.163273 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.compute.api [None req-cae76eb5-3d0f-4a23-9a1d-f6c7a256d116 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] [instance: 4d250aae-2844-46c3-bd51-e2a5330d9b6e] Fetching instance by UUID {{(pid=115761) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:19.169382 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cae76eb5-3d0f-4a23-9a1d-f6c7a256d116 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:19.169875 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cae76eb5-3d0f-4a23-9a1d-f6c7a256d116 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:19.170634 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cae76eb5-3d0f-4a23-9a1d-f6c7a256d116 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:19.171064 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG oslo_concurrency.lockutils [None req-cae76eb5-3d0f-4a23-9a1d-f6c7a256d116 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Lock "7348e7ae-6880-4f81-9ff6-b2f30a471bee" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:19.187426 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.wsgi [None req-cae76eb5-3d0f-4a23-9a1d-f6c7a256d116 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] HTTP exception thrown: Instance 4d250aae-2844-46c3-bd51-e2a5330d9b6e could not be found. Jan 28 02:14:19.188024 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: DEBUG nova.api.openstack.wsgi [None req-cae76eb5-3d0f-4a23-9a1d-f6c7a256d116 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] Returning 404 to user: Instance 4d250aae-2844-46c3-bd51-e2a5330d9b6e could not be found. {{(pid=115761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:14:19.188853 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO nova.api.openstack.requestlog [None req-cae76eb5-3d0f-4a23-9a1d-f6c7a256d116 tempest-VolumesNegativeTest-80319153 tempest-VolumesNegativeTest-80319153-project] 10.222.0.77 "GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e" status: 404 len: 111 microversion: 2.1 time: 0.030842 Jan 28 02:14:19.189406 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: [pid: 115761|app: 0|req: 615/1218] 10.222.0.77 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:19 2022] GET /compute/v2.1/servers/4d250aae-2844-46c3-bd51-e2a5330d9b6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:14:39.274857 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:14:39.275544 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: Fri Jan 28 02:14:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:15:33.984143 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:15:33.984865 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: Fri Jan 28 02:15:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:16:21.985292 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:16:21.986104 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: Fri Jan 28 02:16:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:16:31.769169 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:16:31.769793 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: Fri Jan 28 02:16:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:16:32.936592 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:16:32.937357 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: Fri Jan 28 02:16:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:16:38.868438 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:16:38.869197 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: Fri Jan 28 02:16:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:17:59.283833 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:17:59.284447 dv-cinder-824979-1-iscsi devstack@n-api.service[115760]: Fri Jan 28 02:17:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:18:53.993342 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:18:53.994025 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: Fri Jan 28 02:18:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:19:41.993077 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:19:41.993785 dv-cinder-824979-1-iscsi devstack@n-api.service[115761]: Fri Jan 28 02:19:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!